00:00:00.001 Started by upstream project "autotest-nightly" build number 3622 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3004 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.118 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.119 The recommended git tool is: git 00:00:00.120 using credential 00000000-0000-0000-0000-000000000002 00:00:00.121 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.156 Fetching changes from the remote Git repository 00:00:00.158 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.183 Using shallow fetch with depth 1 00:00:00.183 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.183 > git --version # timeout=10 00:00:00.198 > git --version # 'git version 2.39.2' 00:00:00.198 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.199 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.199 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.612 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.622 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.633 Checking out Revision 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 (FETCH_HEAD) 00:00:04.633 > git config core.sparsecheckout # timeout=10 00:00:04.641 > git read-tree -mu HEAD # timeout=10 00:00:04.654 > git checkout -f 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=5 00:00:04.671 Commit message: "perf/upload_to_db: update columns after changes in get_results.sh" 00:00:04.671 > git rev-list --no-walk 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=10 00:00:04.754 [Pipeline] Start of Pipeline 00:00:04.765 [Pipeline] library 00:00:04.767 Loading library shm_lib@master 00:00:04.767 Library shm_lib@master is cached. Copying from home. 00:00:04.779 [Pipeline] node 00:00:04.790 Running on WFP37 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:04.791 [Pipeline] { 00:00:04.799 [Pipeline] catchError 00:00:04.800 [Pipeline] { 00:00:04.808 [Pipeline] wrap 00:00:04.813 [Pipeline] { 00:00:04.818 [Pipeline] stage 00:00:04.820 [Pipeline] { (Prologue) 00:00:04.965 [Pipeline] sh 00:00:05.242 + logger -p user.info -t JENKINS-CI 00:00:05.255 [Pipeline] echo 00:00:05.256 Node: WFP37 00:00:05.263 [Pipeline] sh 00:00:05.557 [Pipeline] setCustomBuildProperty 00:00:05.565 [Pipeline] echo 00:00:05.566 Cleanup processes 00:00:05.569 [Pipeline] sh 00:00:05.848 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:05.848 1035724 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:05.861 [Pipeline] sh 00:00:06.168 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:06.168 ++ grep -v 'sudo pgrep' 00:00:06.168 ++ awk '{print $1}' 00:00:06.168 + sudo kill -9 00:00:06.168 + true 00:00:06.179 [Pipeline] cleanWs 00:00:06.187 [WS-CLEANUP] Deleting project workspace... 00:00:06.187 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.192 [WS-CLEANUP] done 00:00:06.196 [Pipeline] setCustomBuildProperty 00:00:06.209 [Pipeline] sh 00:00:06.491 + sudo git config --global --replace-all safe.directory '*' 00:00:06.545 [Pipeline] nodesByLabel 00:00:06.546 Could not find any nodes with 'sorcerer' label 00:00:06.549 [Pipeline] retry 00:00:06.550 [Pipeline] { 00:00:06.564 [Pipeline] checkout 00:00:06.568 The recommended git tool is: git 00:00:06.576 using credential 00000000-0000-0000-0000-000000000002 00:00:06.580 Cloning the remote Git repository 00:00:06.582 Honoring refspec on initial clone 00:00:06.585 Cloning repository https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:06.585 > git init /var/jenkins/workspace/nvmf-phy-autotest/jbp # timeout=10 00:00:06.592 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:06.592 > git --version # timeout=10 00:00:06.593 > git --version # 'git version 2.43.0' 00:00:06.593 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:06.594 Setting http proxy: proxy-dmz.intel.com:911 00:00:06.594 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=10 00:00:26.691 Avoid second fetch 00:00:26.707 Checking out Revision 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 (FETCH_HEAD) 00:00:26.790 Commit message: "perf/upload_to_db: update columns after changes in get_results.sh" 00:00:26.796 [Pipeline] } 00:00:26.817 [Pipeline] // retry 00:00:26.829 [Pipeline] nodesByLabel 00:00:26.831 Could not find any nodes with 'sorcerer' label 00:00:26.836 [Pipeline] retry 00:00:26.838 [Pipeline] { 00:00:26.860 [Pipeline] checkout 00:00:26.867 The recommended git tool is: NONE 00:00:26.877 using credential 00000000-0000-0000-0000-000000000002 00:00:26.881 Cloning the remote Git repository 00:00:26.884 Honoring refspec on initial clone 00:00:26.887 Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk 00:00:26.888 > git init /var/jenkins/workspace/nvmf-phy-autotest/spdk # timeout=10 00:00:26.894 Using reference repository: /var/ci_repos/spdk_multi 00:00:26.894 Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk 00:00:26.894 > git --version # timeout=10 00:00:26.898 > git --version # 'git version 2.43.0' 00:00:26.898 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:26.899 Setting http proxy: proxy-dmz.intel.com:911 00:00:26.899 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/heads/master +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:26.678 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:26.681 > git config --add remote.origin.fetch refs/heads/master # timeout=10 00:00:26.694 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:26.702 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:26.710 > git config core.sparsecheckout # timeout=10 00:00:26.715 > git checkout -f 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=10 00:01:14.581 Avoid second fetch 00:01:14.596 Checking out Revision 3f2c8979187809f9b3b0766ead4b91dc70fd73c6 (FETCH_HEAD) 00:01:14.762 Commit message: "event: switch reactors to poll mode before stopping" 00:01:14.568 > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10 00:01:14.570 > git config --add remote.origin.fetch refs/heads/master # timeout=10 00:01:14.572 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 00:01:14.583 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:01:14.591 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:01:14.600 > git config core.sparsecheckout # timeout=10 00:01:14.604 > git checkout -f 3f2c8979187809f9b3b0766ead4b91dc70fd73c6 # timeout=10 00:01:14.766 > git rev-list --no-walk 3f2c8979187809f9b3b0766ead4b91dc70fd73c6 # timeout=10 00:01:14.788 > git remote # timeout=10 00:01:14.792 > git submodule init # timeout=10 00:01:14.864 > git submodule sync # timeout=10 00:01:14.930 > git config --get remote.origin.url # timeout=10 00:01:14.938 > git submodule init # timeout=10 00:01:15.010 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:01:15.014 > git config --get submodule.dpdk.url # timeout=10 00:01:15.019 > git remote # timeout=10 00:01:15.024 > git config --get remote.origin.url # timeout=10 00:01:15.028 > git config -f .gitmodules --get submodule.dpdk.path # timeout=10 00:01:15.032 > git config --get submodule.intel-ipsec-mb.url # timeout=10 00:01:15.037 > git remote # timeout=10 00:01:15.042 > git config --get remote.origin.url # timeout=10 00:01:15.044 > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10 00:01:15.049 > git config --get submodule.isa-l.url # timeout=10 00:01:15.053 > git remote # timeout=10 00:01:15.057 > git config --get remote.origin.url # timeout=10 00:01:15.062 > git config -f .gitmodules --get submodule.isa-l.path # timeout=10 00:01:15.066 > git config --get submodule.ocf.url # timeout=10 00:01:15.070 > git remote # timeout=10 00:01:15.074 > git config --get remote.origin.url # timeout=10 00:01:15.079 > git config -f .gitmodules --get submodule.ocf.path # timeout=10 00:01:15.081 > git config --get submodule.libvfio-user.url # timeout=10 00:01:15.086 > git remote # timeout=10 00:01:15.090 > git config --get remote.origin.url # timeout=10 00:01:15.094 > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10 00:01:15.098 > git config --get submodule.xnvme.url # timeout=10 00:01:15.103 > git remote # timeout=10 00:01:15.107 > git config --get remote.origin.url # timeout=10 00:01:15.112 > git config -f .gitmodules --get submodule.xnvme.path # timeout=10 00:01:15.116 > git config --get submodule.isa-l-crypto.url # timeout=10 00:01:15.121 > git remote # timeout=10 00:01:15.125 > git config --get remote.origin.url # timeout=10 00:01:15.129 > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.136 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:01:15.136 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10 00:01:15.137 Setting http proxy: proxy-dmz.intel.com:911 00:01:15.137 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10 00:01:23.340 [Pipeline] } 00:01:23.357 [Pipeline] // retry 00:01:23.364 [Pipeline] sh 00:01:23.645 + git -C spdk log --oneline -n5 00:01:23.645 3f2c8979187 event: switch reactors to poll mode before stopping 00:01:23.645 443e1ea3147 setup.sh: emit command line to /dev/kmsg on Linux 00:01:23.645 a1264177cd2 pkgdep/git: Adjust ICE driver to kernel >= 6.8.x 00:01:23.645 af95268b18e pkgdep/git: Adjust QAT driver to kernel >= 6.8.x 00:01:23.645 5e75b9137ab scripts/pkgdep: Simplify mdl installation 00:01:23.657 [Pipeline] } 00:01:23.672 [Pipeline] // stage 00:01:23.680 [Pipeline] stage 00:01:23.682 [Pipeline] { (Prepare) 00:01:23.698 [Pipeline] writeFile 00:01:23.714 [Pipeline] sh 00:01:23.994 + logger -p user.info -t JENKINS-CI 00:01:24.006 [Pipeline] sh 00:01:24.284 + logger -p user.info -t JENKINS-CI 00:01:24.296 [Pipeline] sh 00:01:24.573 + cat autorun-spdk.conf 00:01:24.573 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.573 SPDK_TEST_NVMF=1 00:01:24.573 SPDK_TEST_NVME_CLI=1 00:01:24.573 SPDK_TEST_NVMF_NICS=mlx5 00:01:24.573 SPDK_RUN_UBSAN=1 00:01:24.573 NET_TYPE=phy 00:01:24.580 RUN_NIGHTLY=1 00:01:24.585 [Pipeline] readFile 00:01:24.607 [Pipeline] withEnv 00:01:24.608 [Pipeline] { 00:01:24.622 [Pipeline] sh 00:01:24.904 + set -ex 00:01:24.905 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:01:24.905 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:01:24.905 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.905 ++ SPDK_TEST_NVMF=1 00:01:24.905 ++ SPDK_TEST_NVME_CLI=1 00:01:24.905 ++ SPDK_TEST_NVMF_NICS=mlx5 00:01:24.905 ++ SPDK_RUN_UBSAN=1 00:01:24.905 ++ NET_TYPE=phy 00:01:24.905 ++ RUN_NIGHTLY=1 00:01:24.905 + case $SPDK_TEST_NVMF_NICS in 00:01:24.905 + DRIVERS=mlx5_ib 00:01:24.905 + [[ -n mlx5_ib ]] 00:01:24.905 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:24.905 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:31.477 rmmod: ERROR: Module irdma is not currently loaded 00:01:31.477 rmmod: ERROR: Module i40iw is not currently loaded 00:01:31.477 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:31.477 + true 00:01:31.477 + for D in $DRIVERS 00:01:31.478 + sudo modprobe mlx5_ib 00:01:31.478 + exit 0 00:01:31.487 [Pipeline] } 00:01:31.506 [Pipeline] // withEnv 00:01:31.512 [Pipeline] } 00:01:31.529 [Pipeline] // stage 00:01:31.539 [Pipeline] catchError 00:01:31.541 [Pipeline] { 00:01:31.558 [Pipeline] timeout 00:01:31.558 Timeout set to expire in 40 min 00:01:31.560 [Pipeline] { 00:01:31.576 [Pipeline] stage 00:01:31.579 [Pipeline] { (Tests) 00:01:31.596 [Pipeline] sh 00:01:31.881 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:01:31.882 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:01:31.882 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:01:31.882 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:01:31.882 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:31.882 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:01:31.882 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:01:31.882 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:01:31.882 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:01:31.882 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:01:31.882 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:01:31.882 + source /etc/os-release 00:01:31.882 ++ NAME='Fedora Linux' 00:01:31.882 ++ VERSION='38 (Cloud Edition)' 00:01:31.882 ++ ID=fedora 00:01:31.882 ++ VERSION_ID=38 00:01:31.882 ++ VERSION_CODENAME= 00:01:31.882 ++ PLATFORM_ID=platform:f38 00:01:31.882 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:31.882 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:31.882 ++ LOGO=fedora-logo-icon 00:01:31.882 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:31.882 ++ HOME_URL=https://fedoraproject.org/ 00:01:31.882 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:31.882 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:31.882 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:31.882 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:31.882 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:31.882 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:31.882 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:31.882 ++ SUPPORT_END=2024-05-14 00:01:31.882 ++ VARIANT='Cloud Edition' 00:01:31.882 ++ VARIANT_ID=cloud 00:01:31.882 + uname -a 00:01:31.882 Linux spdk-wfp-37 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:31.882 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:01:34.447 Hugepages 00:01:34.447 node hugesize free / total 00:01:34.447 node0 1048576kB 0 / 0 00:01:34.447 node0 2048kB 0 / 0 00:01:34.447 node1 1048576kB 0 / 0 00:01:34.447 node1 2048kB 0 / 0 00:01:34.447 00:01:34.447 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:34.447 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:01:34.447 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:01:34.448 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:01:34.448 NVMe 0000:d8:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:34.448 + rm -f /tmp/spdk-ld-path 00:01:34.448 + source autorun-spdk.conf 00:01:34.448 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:34.448 ++ SPDK_TEST_NVMF=1 00:01:34.448 ++ SPDK_TEST_NVME_CLI=1 00:01:34.448 ++ SPDK_TEST_NVMF_NICS=mlx5 00:01:34.448 ++ SPDK_RUN_UBSAN=1 00:01:34.448 ++ NET_TYPE=phy 00:01:34.448 ++ RUN_NIGHTLY=1 00:01:34.448 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:34.448 + [[ -n '' ]] 00:01:34.448 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:34.448 + for M in /var/spdk/build-*-manifest.txt 00:01:34.448 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:34.448 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:01:34.448 + for M in /var/spdk/build-*-manifest.txt 00:01:34.448 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:34.448 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:01:34.448 ++ uname 00:01:34.448 + [[ Linux == \L\i\n\u\x ]] 00:01:34.448 + sudo dmesg -T 00:01:34.448 + sudo dmesg --clear 00:01:34.448 + dmesg_pid=1037372 00:01:34.448 + [[ Fedora Linux == FreeBSD ]] 00:01:34.448 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:34.448 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:34.448 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:34.448 + [[ -x /usr/src/fio-static/fio ]] 00:01:34.448 + export FIO_BIN=/usr/src/fio-static/fio 00:01:34.448 + FIO_BIN=/usr/src/fio-static/fio 00:01:34.448 + sudo dmesg -Tw 00:01:34.448 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:34.448 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:34.448 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:34.448 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:34.448 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:34.448 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:34.448 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:34.448 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:34.448 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:01:34.448 Test configuration: 00:01:34.708 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:34.708 SPDK_TEST_NVMF=1 00:01:34.708 SPDK_TEST_NVME_CLI=1 00:01:34.708 SPDK_TEST_NVMF_NICS=mlx5 00:01:34.708 SPDK_RUN_UBSAN=1 00:01:34.708 NET_TYPE=phy 00:01:34.708 RUN_NIGHTLY=1 21:02:28 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:01:34.708 21:02:28 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:34.708 21:02:28 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:34.708 21:02:28 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:34.708 21:02:28 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.708 21:02:28 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.708 21:02:28 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.708 21:02:28 -- paths/export.sh@5 -- $ export PATH 00:01:34.708 21:02:28 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.708 21:02:28 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:01:34.708 21:02:28 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:34.708 21:02:28 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713898948.XXXXXX 00:01:34.708 21:02:28 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713898948.tRj4te 00:01:34.708 21:02:28 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:34.708 21:02:28 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:34.708 21:02:28 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:01:34.708 21:02:28 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:34.708 21:02:28 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:34.708 21:02:28 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:34.708 21:02:28 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:01:34.708 21:02:28 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.708 21:02:28 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:34.708 21:02:28 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:01:34.708 21:02:28 -- pm/common@17 -- $ local monitor 00:01:34.708 21:02:28 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:34.708 21:02:28 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1037407 00:01:34.708 21:02:28 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:34.708 21:02:28 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1037409 00:01:34.708 21:02:28 -- pm/common@21 -- $ date +%s 00:01:34.708 21:02:28 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:34.708 21:02:28 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1037412 00:01:34.708 21:02:28 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:34.708 21:02:28 -- pm/common@21 -- $ date +%s 00:01:34.708 21:02:28 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713898948 00:01:34.708 21:02:28 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1037414 00:01:34.708 21:02:28 -- pm/common@26 -- $ sleep 1 00:01:34.708 21:02:28 -- pm/common@21 -- $ date +%s 00:01:34.709 21:02:28 -- pm/common@21 -- $ date +%s 00:01:34.709 21:02:28 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713898948 00:01:34.709 21:02:28 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713898948 00:01:34.709 21:02:28 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713898948 00:01:34.709 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713898948_collect-cpu-load.pm.log 00:01:34.709 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713898948_collect-vmstat.pm.log 00:01:34.709 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713898948_collect-bmc-pm.bmc.pm.log 00:01:34.709 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713898948_collect-cpu-temp.pm.log 00:01:35.643 21:02:29 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:01:35.643 21:02:29 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:35.643 21:02:29 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:35.643 21:02:29 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:35.643 21:02:29 -- spdk/autobuild.sh@16 -- $ date -u 00:01:35.643 Tue Apr 23 07:02:29 PM UTC 2024 00:01:35.643 21:02:29 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:35.643 v24.05-pre-437-g3f2c8979187 00:01:35.643 21:02:29 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:35.643 21:02:29 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:35.643 21:02:29 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:35.643 21:02:29 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:35.643 21:02:29 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:35.643 21:02:29 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.902 ************************************ 00:01:35.902 START TEST ubsan 00:01:35.902 ************************************ 00:01:35.902 21:02:29 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:01:35.902 using ubsan 00:01:35.902 00:01:35.902 real 0m0.000s 00:01:35.902 user 0m0.000s 00:01:35.902 sys 0m0.000s 00:01:35.902 21:02:29 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:35.902 21:02:29 -- common/autotest_common.sh@10 -- $ set +x 00:01:35.902 ************************************ 00:01:35.902 END TEST ubsan 00:01:35.902 ************************************ 00:01:35.902 21:02:30 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:35.902 21:02:30 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:35.902 21:02:30 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:35.902 21:02:30 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:35.902 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:01:35.902 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:36.161 Using 'verbs' RDMA provider 00:01:49.313 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:59.298 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:59.298 Creating mk/config.mk...done. 00:01:59.298 Creating mk/cc.flags.mk...done. 00:01:59.298 Type 'make' to build. 00:01:59.298 21:02:53 -- spdk/autobuild.sh@69 -- $ run_test make make -j112 00:01:59.298 21:02:53 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:59.298 21:02:53 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:59.299 21:02:53 -- common/autotest_common.sh@10 -- $ set +x 00:01:59.299 ************************************ 00:01:59.299 START TEST make 00:01:59.299 ************************************ 00:01:59.299 21:02:53 -- common/autotest_common.sh@1111 -- $ make -j112 00:01:59.560 make[1]: Nothing to be done for 'all'. 00:02:06.126 The Meson build system 00:02:06.126 Version: 1.3.1 00:02:06.126 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:02:06.127 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:02:06.127 Build type: native build 00:02:06.127 Program cat found: YES (/usr/bin/cat) 00:02:06.127 Project name: DPDK 00:02:06.127 Project version: 23.11.0 00:02:06.127 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:02:06.127 C linker for the host machine: cc ld.bfd 2.39-16 00:02:06.127 Host machine cpu family: x86_64 00:02:06.127 Host machine cpu: x86_64 00:02:06.127 Message: ## Building in Developer Mode ## 00:02:06.127 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:06.127 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:02:06.127 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:06.127 Program python3 found: YES (/usr/bin/python3) 00:02:06.127 Program cat found: YES (/usr/bin/cat) 00:02:06.127 Compiler for C supports arguments -march=native: YES 00:02:06.127 Checking for size of "void *" : 8 00:02:06.127 Checking for size of "void *" : 8 (cached) 00:02:06.127 Library m found: YES 00:02:06.127 Library numa found: YES 00:02:06.127 Has header "numaif.h" : YES 00:02:06.127 Library fdt found: NO 00:02:06.127 Library execinfo found: NO 00:02:06.127 Has header "execinfo.h" : YES 00:02:06.127 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:02:06.127 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:06.127 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:06.127 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:06.127 Run-time dependency openssl found: YES 3.0.9 00:02:06.127 Run-time dependency libpcap found: YES 1.10.4 00:02:06.127 Has header "pcap.h" with dependency libpcap: YES 00:02:06.127 Compiler for C supports arguments -Wcast-qual: YES 00:02:06.127 Compiler for C supports arguments -Wdeprecated: YES 00:02:06.127 Compiler for C supports arguments -Wformat: YES 00:02:06.127 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:06.127 Compiler for C supports arguments -Wformat-security: NO 00:02:06.127 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:06.127 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:06.127 Compiler for C supports arguments -Wnested-externs: YES 00:02:06.127 Compiler for C supports arguments -Wold-style-definition: YES 00:02:06.127 Compiler for C supports arguments -Wpointer-arith: YES 00:02:06.127 Compiler for C supports arguments -Wsign-compare: YES 00:02:06.127 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:06.127 Compiler for C supports arguments -Wundef: YES 00:02:06.127 Compiler for C supports arguments -Wwrite-strings: YES 00:02:06.127 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:06.127 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:06.127 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:06.127 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:06.127 Program objdump found: YES (/usr/bin/objdump) 00:02:06.127 Compiler for C supports arguments -mavx512f: YES 00:02:06.127 Checking if "AVX512 checking" compiles: YES 00:02:06.127 Fetching value of define "__SSE4_2__" : 1 00:02:06.127 Fetching value of define "__AES__" : 1 00:02:06.127 Fetching value of define "__AVX__" : 1 00:02:06.127 Fetching value of define "__AVX2__" : 1 00:02:06.127 Fetching value of define "__AVX512BW__" : 1 00:02:06.127 Fetching value of define "__AVX512CD__" : 1 00:02:06.127 Fetching value of define "__AVX512DQ__" : 1 00:02:06.127 Fetching value of define "__AVX512F__" : 1 00:02:06.127 Fetching value of define "__AVX512VL__" : 1 00:02:06.127 Fetching value of define "__PCLMUL__" : 1 00:02:06.127 Fetching value of define "__RDRND__" : 1 00:02:06.127 Fetching value of define "__RDSEED__" : 1 00:02:06.127 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:06.127 Fetching value of define "__znver1__" : (undefined) 00:02:06.127 Fetching value of define "__znver2__" : (undefined) 00:02:06.127 Fetching value of define "__znver3__" : (undefined) 00:02:06.127 Fetching value of define "__znver4__" : (undefined) 00:02:06.127 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:06.127 Message: lib/log: Defining dependency "log" 00:02:06.127 Message: lib/kvargs: Defining dependency "kvargs" 00:02:06.127 Message: lib/telemetry: Defining dependency "telemetry" 00:02:06.127 Checking for function "getentropy" : NO 00:02:06.127 Message: lib/eal: Defining dependency "eal" 00:02:06.127 Message: lib/ring: Defining dependency "ring" 00:02:06.127 Message: lib/rcu: Defining dependency "rcu" 00:02:06.127 Message: lib/mempool: Defining dependency "mempool" 00:02:06.127 Message: lib/mbuf: Defining dependency "mbuf" 00:02:06.127 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:06.127 Fetching value of define "__AVX512F__" : 1 (cached) 00:02:06.127 Fetching value of define "__AVX512BW__" : 1 (cached) 00:02:06.127 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:02:06.127 Fetching value of define "__AVX512VL__" : 1 (cached) 00:02:06.127 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:02:06.127 Compiler for C supports arguments -mpclmul: YES 00:02:06.127 Compiler for C supports arguments -maes: YES 00:02:06.127 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:06.127 Compiler for C supports arguments -mavx512bw: YES 00:02:06.127 Compiler for C supports arguments -mavx512dq: YES 00:02:06.127 Compiler for C supports arguments -mavx512vl: YES 00:02:06.127 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:06.127 Compiler for C supports arguments -mavx2: YES 00:02:06.127 Compiler for C supports arguments -mavx: YES 00:02:06.127 Message: lib/net: Defining dependency "net" 00:02:06.127 Message: lib/meter: Defining dependency "meter" 00:02:06.127 Message: lib/ethdev: Defining dependency "ethdev" 00:02:06.127 Message: lib/pci: Defining dependency "pci" 00:02:06.127 Message: lib/cmdline: Defining dependency "cmdline" 00:02:06.127 Message: lib/hash: Defining dependency "hash" 00:02:06.127 Message: lib/timer: Defining dependency "timer" 00:02:06.127 Message: lib/compressdev: Defining dependency "compressdev" 00:02:06.127 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:06.127 Message: lib/dmadev: Defining dependency "dmadev" 00:02:06.127 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:06.127 Message: lib/power: Defining dependency "power" 00:02:06.127 Message: lib/reorder: Defining dependency "reorder" 00:02:06.127 Message: lib/security: Defining dependency "security" 00:02:06.127 Has header "linux/userfaultfd.h" : YES 00:02:06.127 Has header "linux/vduse.h" : YES 00:02:06.127 Message: lib/vhost: Defining dependency "vhost" 00:02:06.127 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:06.127 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:06.127 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:06.127 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:06.127 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:06.127 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:06.127 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:06.127 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:06.127 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:06.127 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:06.127 Program doxygen found: YES (/usr/bin/doxygen) 00:02:06.127 Configuring doxy-api-html.conf using configuration 00:02:06.127 Configuring doxy-api-man.conf using configuration 00:02:06.127 Program mandb found: YES (/usr/bin/mandb) 00:02:06.127 Program sphinx-build found: NO 00:02:06.127 Configuring rte_build_config.h using configuration 00:02:06.127 Message: 00:02:06.127 ================= 00:02:06.127 Applications Enabled 00:02:06.127 ================= 00:02:06.127 00:02:06.127 apps: 00:02:06.127 00:02:06.127 00:02:06.127 Message: 00:02:06.127 ================= 00:02:06.127 Libraries Enabled 00:02:06.127 ================= 00:02:06.127 00:02:06.127 libs: 00:02:06.127 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:06.127 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:06.127 cryptodev, dmadev, power, reorder, security, vhost, 00:02:06.127 00:02:06.127 Message: 00:02:06.127 =============== 00:02:06.127 Drivers Enabled 00:02:06.127 =============== 00:02:06.127 00:02:06.127 common: 00:02:06.127 00:02:06.127 bus: 00:02:06.127 pci, vdev, 00:02:06.127 mempool: 00:02:06.127 ring, 00:02:06.127 dma: 00:02:06.127 00:02:06.127 net: 00:02:06.127 00:02:06.127 crypto: 00:02:06.127 00:02:06.127 compress: 00:02:06.127 00:02:06.127 vdpa: 00:02:06.127 00:02:06.127 00:02:06.127 Message: 00:02:06.127 ================= 00:02:06.127 Content Skipped 00:02:06.127 ================= 00:02:06.127 00:02:06.127 apps: 00:02:06.127 dumpcap: explicitly disabled via build config 00:02:06.127 graph: explicitly disabled via build config 00:02:06.127 pdump: explicitly disabled via build config 00:02:06.127 proc-info: explicitly disabled via build config 00:02:06.127 test-acl: explicitly disabled via build config 00:02:06.127 test-bbdev: explicitly disabled via build config 00:02:06.127 test-cmdline: explicitly disabled via build config 00:02:06.127 test-compress-perf: explicitly disabled via build config 00:02:06.127 test-crypto-perf: explicitly disabled via build config 00:02:06.127 test-dma-perf: explicitly disabled via build config 00:02:06.127 test-eventdev: explicitly disabled via build config 00:02:06.127 test-fib: explicitly disabled via build config 00:02:06.127 test-flow-perf: explicitly disabled via build config 00:02:06.127 test-gpudev: explicitly disabled via build config 00:02:06.127 test-mldev: explicitly disabled via build config 00:02:06.127 test-pipeline: explicitly disabled via build config 00:02:06.127 test-pmd: explicitly disabled via build config 00:02:06.127 test-regex: explicitly disabled via build config 00:02:06.127 test-sad: explicitly disabled via build config 00:02:06.127 test-security-perf: explicitly disabled via build config 00:02:06.127 00:02:06.127 libs: 00:02:06.127 metrics: explicitly disabled via build config 00:02:06.127 acl: explicitly disabled via build config 00:02:06.127 bbdev: explicitly disabled via build config 00:02:06.128 bitratestats: explicitly disabled via build config 00:02:06.128 bpf: explicitly disabled via build config 00:02:06.128 cfgfile: explicitly disabled via build config 00:02:06.128 distributor: explicitly disabled via build config 00:02:06.128 efd: explicitly disabled via build config 00:02:06.128 eventdev: explicitly disabled via build config 00:02:06.128 dispatcher: explicitly disabled via build config 00:02:06.128 gpudev: explicitly disabled via build config 00:02:06.128 gro: explicitly disabled via build config 00:02:06.128 gso: explicitly disabled via build config 00:02:06.128 ip_frag: explicitly disabled via build config 00:02:06.128 jobstats: explicitly disabled via build config 00:02:06.128 latencystats: explicitly disabled via build config 00:02:06.128 lpm: explicitly disabled via build config 00:02:06.128 member: explicitly disabled via build config 00:02:06.128 pcapng: explicitly disabled via build config 00:02:06.128 rawdev: explicitly disabled via build config 00:02:06.128 regexdev: explicitly disabled via build config 00:02:06.128 mldev: explicitly disabled via build config 00:02:06.128 rib: explicitly disabled via build config 00:02:06.128 sched: explicitly disabled via build config 00:02:06.128 stack: explicitly disabled via build config 00:02:06.128 ipsec: explicitly disabled via build config 00:02:06.128 pdcp: explicitly disabled via build config 00:02:06.128 fib: explicitly disabled via build config 00:02:06.128 port: explicitly disabled via build config 00:02:06.128 pdump: explicitly disabled via build config 00:02:06.128 table: explicitly disabled via build config 00:02:06.128 pipeline: explicitly disabled via build config 00:02:06.128 graph: explicitly disabled via build config 00:02:06.128 node: explicitly disabled via build config 00:02:06.128 00:02:06.128 drivers: 00:02:06.128 common/cpt: not in enabled drivers build config 00:02:06.128 common/dpaax: not in enabled drivers build config 00:02:06.128 common/iavf: not in enabled drivers build config 00:02:06.128 common/idpf: not in enabled drivers build config 00:02:06.128 common/mvep: not in enabled drivers build config 00:02:06.128 common/octeontx: not in enabled drivers build config 00:02:06.128 bus/auxiliary: not in enabled drivers build config 00:02:06.128 bus/cdx: not in enabled drivers build config 00:02:06.128 bus/dpaa: not in enabled drivers build config 00:02:06.128 bus/fslmc: not in enabled drivers build config 00:02:06.128 bus/ifpga: not in enabled drivers build config 00:02:06.128 bus/platform: not in enabled drivers build config 00:02:06.128 bus/vmbus: not in enabled drivers build config 00:02:06.128 common/cnxk: not in enabled drivers build config 00:02:06.128 common/mlx5: not in enabled drivers build config 00:02:06.128 common/nfp: not in enabled drivers build config 00:02:06.128 common/qat: not in enabled drivers build config 00:02:06.128 common/sfc_efx: not in enabled drivers build config 00:02:06.128 mempool/bucket: not in enabled drivers build config 00:02:06.128 mempool/cnxk: not in enabled drivers build config 00:02:06.128 mempool/dpaa: not in enabled drivers build config 00:02:06.128 mempool/dpaa2: not in enabled drivers build config 00:02:06.128 mempool/octeontx: not in enabled drivers build config 00:02:06.128 mempool/stack: not in enabled drivers build config 00:02:06.128 dma/cnxk: not in enabled drivers build config 00:02:06.128 dma/dpaa: not in enabled drivers build config 00:02:06.128 dma/dpaa2: not in enabled drivers build config 00:02:06.128 dma/hisilicon: not in enabled drivers build config 00:02:06.128 dma/idxd: not in enabled drivers build config 00:02:06.128 dma/ioat: not in enabled drivers build config 00:02:06.128 dma/skeleton: not in enabled drivers build config 00:02:06.128 net/af_packet: not in enabled drivers build config 00:02:06.128 net/af_xdp: not in enabled drivers build config 00:02:06.128 net/ark: not in enabled drivers build config 00:02:06.128 net/atlantic: not in enabled drivers build config 00:02:06.128 net/avp: not in enabled drivers build config 00:02:06.128 net/axgbe: not in enabled drivers build config 00:02:06.128 net/bnx2x: not in enabled drivers build config 00:02:06.128 net/bnxt: not in enabled drivers build config 00:02:06.128 net/bonding: not in enabled drivers build config 00:02:06.128 net/cnxk: not in enabled drivers build config 00:02:06.128 net/cpfl: not in enabled drivers build config 00:02:06.128 net/cxgbe: not in enabled drivers build config 00:02:06.128 net/dpaa: not in enabled drivers build config 00:02:06.128 net/dpaa2: not in enabled drivers build config 00:02:06.128 net/e1000: not in enabled drivers build config 00:02:06.128 net/ena: not in enabled drivers build config 00:02:06.128 net/enetc: not in enabled drivers build config 00:02:06.128 net/enetfec: not in enabled drivers build config 00:02:06.128 net/enic: not in enabled drivers build config 00:02:06.128 net/failsafe: not in enabled drivers build config 00:02:06.128 net/fm10k: not in enabled drivers build config 00:02:06.128 net/gve: not in enabled drivers build config 00:02:06.128 net/hinic: not in enabled drivers build config 00:02:06.128 net/hns3: not in enabled drivers build config 00:02:06.128 net/i40e: not in enabled drivers build config 00:02:06.128 net/iavf: not in enabled drivers build config 00:02:06.128 net/ice: not in enabled drivers build config 00:02:06.128 net/idpf: not in enabled drivers build config 00:02:06.128 net/igc: not in enabled drivers build config 00:02:06.128 net/ionic: not in enabled drivers build config 00:02:06.128 net/ipn3ke: not in enabled drivers build config 00:02:06.128 net/ixgbe: not in enabled drivers build config 00:02:06.128 net/mana: not in enabled drivers build config 00:02:06.128 net/memif: not in enabled drivers build config 00:02:06.128 net/mlx4: not in enabled drivers build config 00:02:06.128 net/mlx5: not in enabled drivers build config 00:02:06.128 net/mvneta: not in enabled drivers build config 00:02:06.128 net/mvpp2: not in enabled drivers build config 00:02:06.128 net/netvsc: not in enabled drivers build config 00:02:06.128 net/nfb: not in enabled drivers build config 00:02:06.128 net/nfp: not in enabled drivers build config 00:02:06.128 net/ngbe: not in enabled drivers build config 00:02:06.128 net/null: not in enabled drivers build config 00:02:06.128 net/octeontx: not in enabled drivers build config 00:02:06.128 net/octeon_ep: not in enabled drivers build config 00:02:06.128 net/pcap: not in enabled drivers build config 00:02:06.128 net/pfe: not in enabled drivers build config 00:02:06.128 net/qede: not in enabled drivers build config 00:02:06.128 net/ring: not in enabled drivers build config 00:02:06.128 net/sfc: not in enabled drivers build config 00:02:06.128 net/softnic: not in enabled drivers build config 00:02:06.128 net/tap: not in enabled drivers build config 00:02:06.128 net/thunderx: not in enabled drivers build config 00:02:06.128 net/txgbe: not in enabled drivers build config 00:02:06.128 net/vdev_netvsc: not in enabled drivers build config 00:02:06.128 net/vhost: not in enabled drivers build config 00:02:06.128 net/virtio: not in enabled drivers build config 00:02:06.128 net/vmxnet3: not in enabled drivers build config 00:02:06.128 raw/*: missing internal dependency, "rawdev" 00:02:06.128 crypto/armv8: not in enabled drivers build config 00:02:06.128 crypto/bcmfs: not in enabled drivers build config 00:02:06.128 crypto/caam_jr: not in enabled drivers build config 00:02:06.128 crypto/ccp: not in enabled drivers build config 00:02:06.128 crypto/cnxk: not in enabled drivers build config 00:02:06.128 crypto/dpaa_sec: not in enabled drivers build config 00:02:06.128 crypto/dpaa2_sec: not in enabled drivers build config 00:02:06.128 crypto/ipsec_mb: not in enabled drivers build config 00:02:06.128 crypto/mlx5: not in enabled drivers build config 00:02:06.128 crypto/mvsam: not in enabled drivers build config 00:02:06.128 crypto/nitrox: not in enabled drivers build config 00:02:06.128 crypto/null: not in enabled drivers build config 00:02:06.128 crypto/octeontx: not in enabled drivers build config 00:02:06.128 crypto/openssl: not in enabled drivers build config 00:02:06.128 crypto/scheduler: not in enabled drivers build config 00:02:06.128 crypto/uadk: not in enabled drivers build config 00:02:06.128 crypto/virtio: not in enabled drivers build config 00:02:06.128 compress/isal: not in enabled drivers build config 00:02:06.128 compress/mlx5: not in enabled drivers build config 00:02:06.128 compress/octeontx: not in enabled drivers build config 00:02:06.128 compress/zlib: not in enabled drivers build config 00:02:06.128 regex/*: missing internal dependency, "regexdev" 00:02:06.128 ml/*: missing internal dependency, "mldev" 00:02:06.128 vdpa/ifc: not in enabled drivers build config 00:02:06.128 vdpa/mlx5: not in enabled drivers build config 00:02:06.128 vdpa/nfp: not in enabled drivers build config 00:02:06.128 vdpa/sfc: not in enabled drivers build config 00:02:06.128 event/*: missing internal dependency, "eventdev" 00:02:06.128 baseband/*: missing internal dependency, "bbdev" 00:02:06.128 gpu/*: missing internal dependency, "gpudev" 00:02:06.128 00:02:06.128 00:02:06.387 Build targets in project: 85 00:02:06.387 00:02:06.387 DPDK 23.11.0 00:02:06.387 00:02:06.387 User defined options 00:02:06.387 buildtype : debug 00:02:06.387 default_library : shared 00:02:06.387 libdir : lib 00:02:06.387 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:02:06.387 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:02:06.387 c_link_args : 00:02:06.387 cpu_instruction_set: native 00:02:06.387 disable_apps : dumpcap,graph,pdump,proc-info,test-acl,test-bbdev,test-cmdline,test-compress-perf,test-crypto-perf,test-dma-perf,test-eventdev,test-fib,test-flow-perf,test-gpudev,test-mldev,test-pipeline,test-pmd,test-regex,test-sad,test-security-perf,test 00:02:06.387 disable_libs : acl,bbdev,bitratestats,bpf,cfgfile,dispatcher,distributor,efd,eventdev,fib,gpudev,graph,gro,gso,ip_frag,ipsec,jobstats,latencystats,lpm,member,metrics,mldev,node,pcapng,pdcp,pdump,pipeline,port,rawdev,regexdev,rib,sched,stack,table 00:02:06.387 enable_docs : false 00:02:06.388 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:06.388 enable_kmods : false 00:02:06.388 tests : false 00:02:06.388 00:02:06.388 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:06.647 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:02:06.917 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:06.917 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:06.917 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:06.917 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:06.917 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:06.917 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:06.917 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:06.917 [8/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:06.917 [9/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:06.917 [10/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:06.917 [11/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:06.917 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:06.917 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:06.917 [14/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:06.917 [15/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:06.917 [16/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:06.917 [17/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:06.917 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:06.917 [19/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:06.917 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:06.917 [21/265] Linking static target lib/librte_kvargs.a 00:02:06.917 [22/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:06.917 [23/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:06.917 [24/265] Linking static target lib/librte_pci.a 00:02:06.917 [25/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:06.917 [26/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:06.917 [27/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:06.917 [28/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:07.180 [29/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:07.180 [30/265] Linking static target lib/librte_log.a 00:02:07.180 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:07.180 [32/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:07.180 [33/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:07.180 [34/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:07.180 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:07.180 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:07.180 [37/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:07.180 [38/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:07.180 [39/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:07.180 [40/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:07.180 [41/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:07.180 [42/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:07.440 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:07.440 [44/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:07.440 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:07.440 [46/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:07.440 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:07.440 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:07.440 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:07.440 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:07.440 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:07.440 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:07.440 [53/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:07.440 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:07.440 [55/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:07.440 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:07.440 [57/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:07.440 [58/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:07.440 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:07.440 [60/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:07.440 [61/265] Linking static target lib/librte_meter.a 00:02:07.440 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:07.440 [63/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:07.440 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:07.440 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:07.440 [66/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:07.440 [67/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:07.440 [68/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:07.440 [69/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.440 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:07.440 [71/265] Linking static target lib/librte_ring.a 00:02:07.440 [72/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:07.440 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:07.440 [74/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:07.440 [75/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:07.440 [76/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:07.440 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:07.440 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:07.440 [79/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:07.440 [80/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:07.440 [81/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:07.440 [82/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:07.440 [83/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:07.440 [84/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:07.440 [85/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:07.440 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:07.440 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:07.440 [88/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:07.440 [89/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:07.440 [90/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:07.440 [91/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:07.440 [92/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.440 [93/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:07.440 [94/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:07.440 [95/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:07.440 [96/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:07.440 [97/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:07.440 [98/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:07.440 [99/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:07.440 [100/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:07.440 [101/265] Linking static target lib/librte_telemetry.a 00:02:07.440 [102/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:07.440 [103/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:07.440 [104/265] Linking static target lib/librte_timer.a 00:02:07.440 [105/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:07.440 [106/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:07.440 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:07.440 [108/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:07.440 [109/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:07.440 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:07.440 [111/265] Linking static target lib/librte_rcu.a 00:02:07.440 [112/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:07.440 [113/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:07.440 [114/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:07.440 [115/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:07.440 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:07.440 [117/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:07.440 [118/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:07.440 [119/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:07.440 [120/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:07.440 [121/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:07.440 [122/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:07.440 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:07.440 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:07.440 [125/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:07.440 [126/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:07.440 [127/265] Linking static target lib/librte_net.a 00:02:07.440 [128/265] Linking static target lib/librte_cmdline.a 00:02:07.440 [129/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:07.440 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:07.440 [131/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:07.440 [132/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:07.440 [133/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:07.440 [134/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:07.440 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:07.440 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:07.440 [137/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:07.699 [138/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:07.699 [139/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:07.699 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:07.699 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:07.699 [142/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:07.699 [143/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:07.699 [144/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.699 [145/265] Linking static target lib/librte_mempool.a 00:02:07.699 [146/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:07.699 [147/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:07.699 [148/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:07.699 [149/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:07.699 [150/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:07.699 [151/265] Linking static target lib/librte_reorder.a 00:02:07.699 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:07.699 [153/265] Linking static target lib/librte_power.a 00:02:07.699 [154/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:07.699 [155/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:07.699 [156/265] Linking static target lib/librte_dmadev.a 00:02:07.699 [157/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:07.699 [158/265] Linking static target lib/librte_compressdev.a 00:02:07.699 [159/265] Linking static target lib/librte_eal.a 00:02:07.699 [160/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.699 [161/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:07.699 [162/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:07.699 [163/265] Linking static target lib/librte_security.a 00:02:07.699 [164/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.700 [165/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:07.700 [166/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:07.700 [167/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:07.700 [168/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:07.700 [169/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:07.700 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:07.700 [171/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:07.700 [172/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:07.700 [173/265] Linking static target lib/librte_mbuf.a 00:02:07.700 [174/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:07.700 [175/265] Linking target lib/librte_log.so.24.0 00:02:07.700 [176/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.700 [177/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.700 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:07.700 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:07.700 [180/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:07.700 [181/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:07.700 [182/265] Linking static target lib/librte_hash.a 00:02:07.959 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:07.959 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:07.959 [185/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:07.959 [186/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:07.959 [187/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.959 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:07.959 [189/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:07.959 [190/265] Linking static target lib/librte_cryptodev.a 00:02:07.959 [191/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:07.959 [192/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:07.959 [193/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.959 [194/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:07.959 [195/265] Linking target lib/librte_kvargs.so.24.0 00:02:07.959 [196/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:07.959 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:07.959 [198/265] Linking static target drivers/librte_bus_vdev.a 00:02:07.959 [199/265] Linking target lib/librte_telemetry.so.24.0 00:02:07.959 [200/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:07.959 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:07.959 [202/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.959 [203/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:07.959 [204/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:07.959 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:07.959 [206/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:07.959 [207/265] Linking static target drivers/librte_bus_pci.a 00:02:07.959 [208/265] Linking static target drivers/librte_mempool_ring.a 00:02:07.959 [209/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:07.959 [210/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:08.218 [211/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:08.218 [212/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.218 [213/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.218 [214/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.218 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.218 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:08.218 [217/265] Linking static target lib/librte_ethdev.a 00:02:08.477 [218/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.477 [219/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.477 [220/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:08.477 [221/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.477 [222/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.736 [223/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.736 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.671 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:09.671 [226/265] Linking static target lib/librte_vhost.a 00:02:09.672 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:11.048 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.317 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.953 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:17.211 [231/265] Linking target lib/librte_eal.so.24.0 00:02:17.211 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:17.211 [233/265] Linking target lib/librte_pci.so.24.0 00:02:17.211 [234/265] Linking target lib/librte_dmadev.so.24.0 00:02:17.211 [235/265] Linking target lib/librte_ring.so.24.0 00:02:17.211 [236/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:17.211 [237/265] Linking target lib/librte_timer.so.24.0 00:02:17.211 [238/265] Linking target lib/librte_meter.so.24.0 00:02:17.469 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:17.469 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:17.469 [241/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:17.469 [242/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:17.469 [243/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:17.469 [244/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:17.469 [245/265] Linking target lib/librte_rcu.so.24.0 00:02:17.469 [246/265] Linking target lib/librte_mempool.so.24.0 00:02:17.469 [247/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:17.728 [248/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:17.728 [249/265] Linking target lib/librte_mbuf.so.24.0 00:02:17.728 [250/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:17.728 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:17.728 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:17.728 [253/265] Linking target lib/librte_compressdev.so.24.0 00:02:17.728 [254/265] Linking target lib/librte_reorder.so.24.0 00:02:17.728 [255/265] Linking target lib/librte_net.so.24.0 00:02:17.986 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:17.986 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:17.986 [258/265] Linking target lib/librte_security.so.24.0 00:02:17.986 [259/265] Linking target lib/librte_cmdline.so.24.0 00:02:17.986 [260/265] Linking target lib/librte_hash.so.24.0 00:02:17.986 [261/265] Linking target lib/librte_ethdev.so.24.0 00:02:17.986 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:18.244 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:18.244 [264/265] Linking target lib/librte_power.so.24.0 00:02:18.244 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:18.244 INFO: autodetecting backend as ninja 00:02:18.244 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 112 00:02:19.177 CC lib/ut/ut.o 00:02:19.177 CC lib/ut_mock/mock.o 00:02:19.177 CC lib/log/log.o 00:02:19.177 CC lib/log/log_flags.o 00:02:19.177 CC lib/log/log_deprecated.o 00:02:19.177 LIB libspdk_ut.a 00:02:19.177 LIB libspdk_ut_mock.a 00:02:19.177 SO libspdk_ut.so.2.0 00:02:19.177 LIB libspdk_log.a 00:02:19.177 SO libspdk_ut_mock.so.6.0 00:02:19.177 SO libspdk_log.so.7.0 00:02:19.177 SYMLINK libspdk_ut.so 00:02:19.177 SYMLINK libspdk_ut_mock.so 00:02:19.435 SYMLINK libspdk_log.so 00:02:19.692 CC lib/ioat/ioat.o 00:02:19.692 CXX lib/trace_parser/trace.o 00:02:19.692 CC lib/dma/dma.o 00:02:19.692 CC lib/util/base64.o 00:02:19.692 CC lib/util/bit_array.o 00:02:19.692 CC lib/util/cpuset.o 00:02:19.692 CC lib/util/crc16.o 00:02:19.692 CC lib/util/crc32.o 00:02:19.692 CC lib/util/crc32c.o 00:02:19.692 CC lib/util/crc32_ieee.o 00:02:19.692 CC lib/util/crc64.o 00:02:19.692 CC lib/util/dif.o 00:02:19.692 CC lib/util/fd.o 00:02:19.692 CC lib/util/file.o 00:02:19.692 CC lib/util/hexlify.o 00:02:19.692 CC lib/util/iov.o 00:02:19.692 CC lib/util/strerror_tls.o 00:02:19.692 CC lib/util/math.o 00:02:19.692 CC lib/util/pipe.o 00:02:19.692 CC lib/util/string.o 00:02:19.692 CC lib/util/fd_group.o 00:02:19.692 CC lib/util/uuid.o 00:02:19.692 CC lib/util/xor.o 00:02:19.692 CC lib/util/zipf.o 00:02:19.692 CC lib/vfio_user/host/vfio_user.o 00:02:19.692 CC lib/vfio_user/host/vfio_user_pci.o 00:02:19.692 LIB libspdk_dma.a 00:02:19.692 LIB libspdk_ioat.a 00:02:19.950 SO libspdk_ioat.so.7.0 00:02:19.950 SO libspdk_dma.so.4.0 00:02:19.950 SYMLINK libspdk_ioat.so 00:02:19.950 SYMLINK libspdk_dma.so 00:02:19.950 LIB libspdk_vfio_user.a 00:02:19.950 SO libspdk_vfio_user.so.5.0 00:02:19.950 LIB libspdk_util.a 00:02:19.950 SYMLINK libspdk_vfio_user.so 00:02:20.207 SO libspdk_util.so.9.0 00:02:20.207 SYMLINK libspdk_util.so 00:02:20.207 LIB libspdk_trace_parser.a 00:02:20.207 SO libspdk_trace_parser.so.5.0 00:02:20.464 SYMLINK libspdk_trace_parser.so 00:02:20.464 CC lib/json/json_parse.o 00:02:20.464 CC lib/json/json_util.o 00:02:20.464 CC lib/json/json_write.o 00:02:20.464 CC lib/idxd/idxd.o 00:02:20.464 CC lib/idxd/idxd_user.o 00:02:20.464 CC lib/vmd/vmd.o 00:02:20.464 CC lib/vmd/led.o 00:02:20.464 CC lib/env_dpdk/env.o 00:02:20.464 CC lib/env_dpdk/memory.o 00:02:20.464 CC lib/env_dpdk/init.o 00:02:20.464 CC lib/env_dpdk/pci.o 00:02:20.464 CC lib/env_dpdk/threads.o 00:02:20.464 CC lib/env_dpdk/pci_ioat.o 00:02:20.464 CC lib/env_dpdk/pci_vmd.o 00:02:20.464 CC lib/env_dpdk/pci_virtio.o 00:02:20.464 CC lib/env_dpdk/pci_idxd.o 00:02:20.464 CC lib/conf/conf.o 00:02:20.464 CC lib/rdma/common.o 00:02:20.464 CC lib/env_dpdk/pci_event.o 00:02:20.464 CC lib/env_dpdk/sigbus_handler.o 00:02:20.464 CC lib/env_dpdk/pci_dpdk.o 00:02:20.464 CC lib/rdma/rdma_verbs.o 00:02:20.464 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:20.464 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:20.721 LIB libspdk_conf.a 00:02:20.721 LIB libspdk_json.a 00:02:20.721 SO libspdk_conf.so.6.0 00:02:20.721 SO libspdk_json.so.6.0 00:02:20.721 LIB libspdk_rdma.a 00:02:20.721 SYMLINK libspdk_conf.so 00:02:20.721 SYMLINK libspdk_json.so 00:02:20.721 SO libspdk_rdma.so.6.0 00:02:20.721 SYMLINK libspdk_rdma.so 00:02:20.978 LIB libspdk_idxd.a 00:02:20.978 SO libspdk_idxd.so.12.0 00:02:20.978 LIB libspdk_vmd.a 00:02:20.978 SYMLINK libspdk_idxd.so 00:02:20.978 SO libspdk_vmd.so.6.0 00:02:20.978 SYMLINK libspdk_vmd.so 00:02:20.978 CC lib/jsonrpc/jsonrpc_server.o 00:02:20.978 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:20.978 CC lib/jsonrpc/jsonrpc_client.o 00:02:20.978 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:21.235 LIB libspdk_jsonrpc.a 00:02:21.235 SO libspdk_jsonrpc.so.6.0 00:02:21.235 SYMLINK libspdk_jsonrpc.so 00:02:21.493 LIB libspdk_env_dpdk.a 00:02:21.493 SO libspdk_env_dpdk.so.14.0 00:02:21.493 SYMLINK libspdk_env_dpdk.so 00:02:21.751 CC lib/rpc/rpc.o 00:02:21.751 LIB libspdk_rpc.a 00:02:21.751 SO libspdk_rpc.so.6.0 00:02:22.009 SYMLINK libspdk_rpc.so 00:02:22.267 CC lib/keyring/keyring.o 00:02:22.267 CC lib/keyring/keyring_rpc.o 00:02:22.267 CC lib/trace/trace_flags.o 00:02:22.267 CC lib/trace/trace.o 00:02:22.267 CC lib/trace/trace_rpc.o 00:02:22.267 CC lib/notify/notify.o 00:02:22.267 CC lib/notify/notify_rpc.o 00:02:22.267 LIB libspdk_notify.a 00:02:22.267 LIB libspdk_keyring.a 00:02:22.267 LIB libspdk_trace.a 00:02:22.526 SO libspdk_keyring.so.1.0 00:02:22.526 SO libspdk_notify.so.6.0 00:02:22.526 SO libspdk_trace.so.10.0 00:02:22.526 SYMLINK libspdk_keyring.so 00:02:22.526 SYMLINK libspdk_notify.so 00:02:22.526 SYMLINK libspdk_trace.so 00:02:22.783 CC lib/sock/sock.o 00:02:22.784 CC lib/sock/sock_rpc.o 00:02:22.784 CC lib/thread/thread.o 00:02:22.784 CC lib/thread/iobuf.o 00:02:23.042 LIB libspdk_sock.a 00:02:23.042 SO libspdk_sock.so.9.0 00:02:23.042 SYMLINK libspdk_sock.so 00:02:23.299 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:23.299 CC lib/nvme/nvme_ctrlr.o 00:02:23.557 CC lib/nvme/nvme_fabric.o 00:02:23.557 CC lib/nvme/nvme_ns_cmd.o 00:02:23.557 CC lib/nvme/nvme_ns.o 00:02:23.557 CC lib/nvme/nvme_pcie_common.o 00:02:23.557 CC lib/nvme/nvme_pcie.o 00:02:23.557 CC lib/nvme/nvme_qpair.o 00:02:23.557 CC lib/nvme/nvme.o 00:02:23.557 CC lib/nvme/nvme_discovery.o 00:02:23.557 CC lib/nvme/nvme_quirks.o 00:02:23.557 CC lib/nvme/nvme_transport.o 00:02:23.557 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:23.557 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:23.557 CC lib/nvme/nvme_tcp.o 00:02:23.557 CC lib/nvme/nvme_opal.o 00:02:23.557 CC lib/nvme/nvme_poll_group.o 00:02:23.557 CC lib/nvme/nvme_io_msg.o 00:02:23.557 CC lib/nvme/nvme_zns.o 00:02:23.557 CC lib/nvme/nvme_stubs.o 00:02:23.557 CC lib/nvme/nvme_auth.o 00:02:23.557 CC lib/nvme/nvme_cuse.o 00:02:23.557 CC lib/nvme/nvme_rdma.o 00:02:23.814 LIB libspdk_thread.a 00:02:23.814 SO libspdk_thread.so.10.0 00:02:23.814 SYMLINK libspdk_thread.so 00:02:24.072 CC lib/init/json_config.o 00:02:24.072 CC lib/init/subsystem.o 00:02:24.072 CC lib/init/subsystem_rpc.o 00:02:24.072 CC lib/init/rpc.o 00:02:24.072 CC lib/accel/accel_sw.o 00:02:24.072 CC lib/accel/accel.o 00:02:24.072 CC lib/accel/accel_rpc.o 00:02:24.072 CC lib/virtio/virtio_vhost_user.o 00:02:24.072 CC lib/virtio/virtio.o 00:02:24.072 CC lib/virtio/virtio_vfio_user.o 00:02:24.072 CC lib/virtio/virtio_pci.o 00:02:24.072 CC lib/blob/blobstore.o 00:02:24.072 CC lib/blob/request.o 00:02:24.072 CC lib/blob/zeroes.o 00:02:24.072 CC lib/blob/blob_bs_dev.o 00:02:24.330 LIB libspdk_init.a 00:02:24.330 SO libspdk_init.so.5.0 00:02:24.330 LIB libspdk_virtio.a 00:02:24.330 SYMLINK libspdk_init.so 00:02:24.330 SO libspdk_virtio.so.7.0 00:02:24.330 SYMLINK libspdk_virtio.so 00:02:24.588 CC lib/event/app.o 00:02:24.588 CC lib/event/reactor.o 00:02:24.588 CC lib/event/log_rpc.o 00:02:24.588 CC lib/event/app_rpc.o 00:02:24.588 CC lib/event/scheduler_static.o 00:02:24.845 LIB libspdk_accel.a 00:02:24.846 SO libspdk_accel.so.15.0 00:02:24.846 SYMLINK libspdk_accel.so 00:02:24.846 LIB libspdk_nvme.a 00:02:24.846 LIB libspdk_event.a 00:02:24.846 SO libspdk_nvme.so.13.0 00:02:24.846 SO libspdk_event.so.13.0 00:02:25.104 SYMLINK libspdk_event.so 00:02:25.104 CC lib/bdev/bdev_rpc.o 00:02:25.104 CC lib/bdev/bdev.o 00:02:25.104 CC lib/bdev/bdev_zone.o 00:02:25.104 CC lib/bdev/part.o 00:02:25.104 CC lib/bdev/scsi_nvme.o 00:02:25.104 SYMLINK libspdk_nvme.so 00:02:26.040 LIB libspdk_blob.a 00:02:26.040 SO libspdk_blob.so.11.0 00:02:26.040 SYMLINK libspdk_blob.so 00:02:26.299 CC lib/blobfs/blobfs.o 00:02:26.299 CC lib/blobfs/tree.o 00:02:26.299 CC lib/lvol/lvol.o 00:02:26.558 LIB libspdk_bdev.a 00:02:26.817 SO libspdk_bdev.so.15.0 00:02:26.817 LIB libspdk_blobfs.a 00:02:26.817 SO libspdk_blobfs.so.10.0 00:02:26.817 LIB libspdk_lvol.a 00:02:26.817 SYMLINK libspdk_bdev.so 00:02:26.817 SYMLINK libspdk_blobfs.so 00:02:26.817 SO libspdk_lvol.so.10.0 00:02:26.817 SYMLINK libspdk_lvol.so 00:02:27.076 CC lib/scsi/dev.o 00:02:27.076 CC lib/scsi/lun.o 00:02:27.076 CC lib/scsi/port.o 00:02:27.076 CC lib/scsi/scsi.o 00:02:27.076 CC lib/scsi/scsi_bdev.o 00:02:27.076 CC lib/scsi/scsi_pr.o 00:02:27.076 CC lib/scsi/scsi_rpc.o 00:02:27.076 CC lib/scsi/task.o 00:02:27.076 CC lib/nvmf/ctrlr.o 00:02:27.076 CC lib/nvmf/ctrlr_discovery.o 00:02:27.076 CC lib/nvmf/ctrlr_bdev.o 00:02:27.076 CC lib/nvmf/subsystem.o 00:02:27.076 CC lib/nvmf/nvmf.o 00:02:27.076 CC lib/nvmf/nvmf_rpc.o 00:02:27.076 CC lib/nvmf/rdma.o 00:02:27.076 CC lib/nvmf/transport.o 00:02:27.076 CC lib/nvmf/tcp.o 00:02:27.076 CC lib/ftl/ftl_core.o 00:02:27.076 CC lib/ftl/ftl_init.o 00:02:27.076 CC lib/ftl/ftl_layout.o 00:02:27.076 CC lib/ftl/ftl_debug.o 00:02:27.076 CC lib/ftl/ftl_io.o 00:02:27.076 CC lib/ftl/ftl_sb.o 00:02:27.076 CC lib/ftl/ftl_l2p.o 00:02:27.076 CC lib/ftl/ftl_l2p_flat.o 00:02:27.076 CC lib/ftl/ftl_nv_cache.o 00:02:27.076 CC lib/ftl/ftl_band.o 00:02:27.076 CC lib/ftl/ftl_band_ops.o 00:02:27.076 CC lib/ftl/ftl_writer.o 00:02:27.076 CC lib/ftl/ftl_rq.o 00:02:27.076 CC lib/ftl/ftl_reloc.o 00:02:27.076 CC lib/ftl/ftl_p2l.o 00:02:27.076 CC lib/ftl/ftl_l2p_cache.o 00:02:27.076 CC lib/ublk/ublk.o 00:02:27.076 CC lib/nbd/nbd.o 00:02:27.076 CC lib/ublk/ublk_rpc.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt.o 00:02:27.076 CC lib/nbd/nbd_rpc.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:27.076 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:27.076 CC lib/ftl/utils/ftl_conf.o 00:02:27.076 CC lib/ftl/utils/ftl_mempool.o 00:02:27.076 CC lib/ftl/utils/ftl_bitmap.o 00:02:27.076 CC lib/ftl/utils/ftl_md.o 00:02:27.076 CC lib/ftl/utils/ftl_property.o 00:02:27.076 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:27.076 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:27.076 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:27.076 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:27.076 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:27.076 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:27.076 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:27.076 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:27.076 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:27.076 CC lib/ftl/base/ftl_base_bdev.o 00:02:27.076 CC lib/ftl/base/ftl_base_dev.o 00:02:27.076 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:27.076 CC lib/ftl/ftl_trace.o 00:02:27.642 LIB libspdk_nbd.a 00:02:27.642 SO libspdk_nbd.so.7.0 00:02:27.642 SYMLINK libspdk_nbd.so 00:02:27.642 LIB libspdk_scsi.a 00:02:27.642 SO libspdk_scsi.so.9.0 00:02:27.642 SYMLINK libspdk_scsi.so 00:02:27.642 LIB libspdk_ublk.a 00:02:27.642 SO libspdk_ublk.so.3.0 00:02:27.900 SYMLINK libspdk_ublk.so 00:02:27.900 LIB libspdk_ftl.a 00:02:27.900 CC lib/iscsi/iscsi.o 00:02:27.900 CC lib/iscsi/conn.o 00:02:27.900 CC lib/vhost/vhost_scsi.o 00:02:27.900 CC lib/vhost/vhost.o 00:02:27.900 CC lib/iscsi/init_grp.o 00:02:27.900 CC lib/iscsi/md5.o 00:02:27.900 CC lib/vhost/vhost_rpc.o 00:02:27.900 CC lib/iscsi/param.o 00:02:27.900 CC lib/vhost/vhost_blk.o 00:02:27.900 CC lib/iscsi/portal_grp.o 00:02:27.900 CC lib/vhost/rte_vhost_user.o 00:02:27.900 CC lib/iscsi/tgt_node.o 00:02:27.900 CC lib/iscsi/iscsi_subsystem.o 00:02:27.900 CC lib/iscsi/iscsi_rpc.o 00:02:27.901 CC lib/iscsi/task.o 00:02:28.159 SO libspdk_ftl.so.9.0 00:02:28.416 SYMLINK libspdk_ftl.so 00:02:28.416 LIB libspdk_nvmf.a 00:02:28.416 SO libspdk_nvmf.so.18.0 00:02:28.675 SYMLINK libspdk_nvmf.so 00:02:28.675 LIB libspdk_vhost.a 00:02:28.675 SO libspdk_vhost.so.8.0 00:02:28.933 SYMLINK libspdk_vhost.so 00:02:28.933 LIB libspdk_iscsi.a 00:02:28.933 SO libspdk_iscsi.so.8.0 00:02:28.933 SYMLINK libspdk_iscsi.so 00:02:29.500 CC module/env_dpdk/env_dpdk_rpc.o 00:02:29.500 CC module/accel/dsa/accel_dsa.o 00:02:29.500 LIB libspdk_env_dpdk_rpc.a 00:02:29.500 CC module/accel/dsa/accel_dsa_rpc.o 00:02:29.501 CC module/accel/iaa/accel_iaa.o 00:02:29.501 CC module/accel/iaa/accel_iaa_rpc.o 00:02:29.501 CC module/blob/bdev/blob_bdev.o 00:02:29.501 CC module/accel/error/accel_error_rpc.o 00:02:29.501 CC module/accel/error/accel_error.o 00:02:29.501 CC module/accel/ioat/accel_ioat.o 00:02:29.501 CC module/accel/ioat/accel_ioat_rpc.o 00:02:29.501 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:29.501 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:29.501 CC module/sock/posix/posix.o 00:02:29.501 CC module/scheduler/gscheduler/gscheduler.o 00:02:29.501 CC module/keyring/file/keyring.o 00:02:29.501 SO libspdk_env_dpdk_rpc.so.6.0 00:02:29.501 CC module/keyring/file/keyring_rpc.o 00:02:29.759 SYMLINK libspdk_env_dpdk_rpc.so 00:02:29.759 LIB libspdk_scheduler_dpdk_governor.a 00:02:29.759 SO libspdk_scheduler_dpdk_governor.so.4.0 00:02:29.759 LIB libspdk_scheduler_gscheduler.a 00:02:29.759 LIB libspdk_keyring_file.a 00:02:29.759 LIB libspdk_accel_error.a 00:02:29.759 LIB libspdk_accel_ioat.a 00:02:29.759 LIB libspdk_scheduler_dynamic.a 00:02:29.759 LIB libspdk_accel_iaa.a 00:02:29.759 LIB libspdk_accel_dsa.a 00:02:29.759 SO libspdk_keyring_file.so.1.0 00:02:29.759 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:29.759 SO libspdk_scheduler_gscheduler.so.4.0 00:02:29.759 SO libspdk_accel_error.so.2.0 00:02:29.759 SO libspdk_accel_ioat.so.6.0 00:02:29.759 SO libspdk_scheduler_dynamic.so.4.0 00:02:29.759 SO libspdk_accel_iaa.so.3.0 00:02:29.759 LIB libspdk_blob_bdev.a 00:02:29.759 SO libspdk_accel_dsa.so.5.0 00:02:29.759 SYMLINK libspdk_keyring_file.so 00:02:29.759 SYMLINK libspdk_scheduler_gscheduler.so 00:02:29.759 SO libspdk_blob_bdev.so.11.0 00:02:29.759 SYMLINK libspdk_scheduler_dynamic.so 00:02:29.759 SYMLINK libspdk_accel_error.so 00:02:29.759 SYMLINK libspdk_accel_ioat.so 00:02:29.759 SYMLINK libspdk_accel_iaa.so 00:02:30.017 SYMLINK libspdk_accel_dsa.so 00:02:30.018 SYMLINK libspdk_blob_bdev.so 00:02:30.018 LIB libspdk_sock_posix.a 00:02:30.277 SO libspdk_sock_posix.so.6.0 00:02:30.277 SYMLINK libspdk_sock_posix.so 00:02:30.277 CC module/bdev/passthru/vbdev_passthru.o 00:02:30.277 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:30.277 CC module/blobfs/bdev/blobfs_bdev.o 00:02:30.277 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:30.277 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:30.277 CC module/bdev/malloc/bdev_malloc.o 00:02:30.277 CC module/bdev/iscsi/bdev_iscsi.o 00:02:30.277 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:30.277 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:30.277 CC module/bdev/gpt/gpt.o 00:02:30.277 CC module/bdev/gpt/vbdev_gpt.o 00:02:30.277 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:30.277 CC module/bdev/split/vbdev_split_rpc.o 00:02:30.277 CC module/bdev/split/vbdev_split.o 00:02:30.277 CC module/bdev/nvme/bdev_nvme.o 00:02:30.277 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:30.277 CC module/bdev/nvme/nvme_rpc.o 00:02:30.277 CC module/bdev/nvme/bdev_mdns_client.o 00:02:30.277 CC module/bdev/delay/vbdev_delay.o 00:02:30.277 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:30.277 CC module/bdev/nvme/vbdev_opal.o 00:02:30.277 CC module/bdev/ftl/bdev_ftl.o 00:02:30.277 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:30.277 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:30.277 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:30.277 CC module/bdev/raid/bdev_raid.o 00:02:30.277 CC module/bdev/raid/bdev_raid_sb.o 00:02:30.277 CC module/bdev/raid/bdev_raid_rpc.o 00:02:30.277 CC module/bdev/aio/bdev_aio.o 00:02:30.277 CC module/bdev/raid/raid0.o 00:02:30.277 CC module/bdev/raid/raid1.o 00:02:30.277 CC module/bdev/lvol/vbdev_lvol.o 00:02:30.277 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:30.277 CC module/bdev/aio/bdev_aio_rpc.o 00:02:30.277 CC module/bdev/error/vbdev_error.o 00:02:30.277 CC module/bdev/raid/concat.o 00:02:30.277 CC module/bdev/error/vbdev_error_rpc.o 00:02:30.277 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:30.277 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:30.277 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:30.277 CC module/bdev/null/bdev_null.o 00:02:30.277 CC module/bdev/null/bdev_null_rpc.o 00:02:30.536 LIB libspdk_blobfs_bdev.a 00:02:30.536 SO libspdk_blobfs_bdev.so.6.0 00:02:30.536 LIB libspdk_bdev_split.a 00:02:30.536 LIB libspdk_bdev_gpt.a 00:02:30.536 LIB libspdk_bdev_null.a 00:02:30.536 LIB libspdk_bdev_passthru.a 00:02:30.536 LIB libspdk_bdev_ftl.a 00:02:30.536 SO libspdk_bdev_split.so.6.0 00:02:30.536 SO libspdk_bdev_null.so.6.0 00:02:30.536 SYMLINK libspdk_blobfs_bdev.so 00:02:30.536 SO libspdk_bdev_gpt.so.6.0 00:02:30.536 LIB libspdk_bdev_error.a 00:02:30.536 SO libspdk_bdev_ftl.so.6.0 00:02:30.536 SO libspdk_bdev_passthru.so.6.0 00:02:30.536 LIB libspdk_bdev_iscsi.a 00:02:30.795 LIB libspdk_bdev_zone_block.a 00:02:30.795 LIB libspdk_bdev_aio.a 00:02:30.795 SO libspdk_bdev_error.so.6.0 00:02:30.795 SYMLINK libspdk_bdev_split.so 00:02:30.795 SO libspdk_bdev_iscsi.so.6.0 00:02:30.795 LIB libspdk_bdev_malloc.a 00:02:30.795 SYMLINK libspdk_bdev_null.so 00:02:30.795 SYMLINK libspdk_bdev_gpt.so 00:02:30.795 SYMLINK libspdk_bdev_ftl.so 00:02:30.795 SO libspdk_bdev_zone_block.so.6.0 00:02:30.795 SYMLINK libspdk_bdev_passthru.so 00:02:30.795 SO libspdk_bdev_aio.so.6.0 00:02:30.795 SO libspdk_bdev_malloc.so.6.0 00:02:30.795 LIB libspdk_bdev_delay.a 00:02:30.795 SYMLINK libspdk_bdev_error.so 00:02:30.795 SYMLINK libspdk_bdev_iscsi.so 00:02:30.795 SO libspdk_bdev_delay.so.6.0 00:02:30.795 SYMLINK libspdk_bdev_zone_block.so 00:02:30.795 LIB libspdk_bdev_lvol.a 00:02:30.795 SYMLINK libspdk_bdev_aio.so 00:02:30.795 SYMLINK libspdk_bdev_malloc.so 00:02:30.795 SO libspdk_bdev_lvol.so.6.0 00:02:30.795 SYMLINK libspdk_bdev_delay.so 00:02:30.795 LIB libspdk_bdev_virtio.a 00:02:30.795 SO libspdk_bdev_virtio.so.6.0 00:02:30.795 SYMLINK libspdk_bdev_lvol.so 00:02:30.795 SYMLINK libspdk_bdev_virtio.so 00:02:31.055 LIB libspdk_bdev_raid.a 00:02:31.055 SO libspdk_bdev_raid.so.6.0 00:02:31.055 SYMLINK libspdk_bdev_raid.so 00:02:32.046 LIB libspdk_bdev_nvme.a 00:02:32.046 SO libspdk_bdev_nvme.so.7.0 00:02:32.046 SYMLINK libspdk_bdev_nvme.so 00:02:32.615 CC module/event/subsystems/keyring/keyring.o 00:02:32.615 CC module/event/subsystems/sock/sock.o 00:02:32.615 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:32.615 CC module/event/subsystems/vmd/vmd.o 00:02:32.615 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:32.615 CC module/event/subsystems/iobuf/iobuf.o 00:02:32.615 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:32.615 CC module/event/subsystems/scheduler/scheduler.o 00:02:32.615 LIB libspdk_event_sock.a 00:02:32.615 LIB libspdk_event_keyring.a 00:02:32.615 LIB libspdk_event_vmd.a 00:02:32.615 SO libspdk_event_sock.so.5.0 00:02:32.615 SO libspdk_event_keyring.so.1.0 00:02:32.615 LIB libspdk_event_iobuf.a 00:02:32.615 LIB libspdk_event_vhost_blk.a 00:02:32.615 LIB libspdk_event_scheduler.a 00:02:32.615 SYMLINK libspdk_event_sock.so 00:02:32.615 SO libspdk_event_vmd.so.6.0 00:02:32.615 SO libspdk_event_vhost_blk.so.3.0 00:02:32.615 SO libspdk_event_iobuf.so.3.0 00:02:32.615 SO libspdk_event_scheduler.so.4.0 00:02:32.615 SYMLINK libspdk_event_keyring.so 00:02:32.615 SYMLINK libspdk_event_vmd.so 00:02:32.875 SYMLINK libspdk_event_vhost_blk.so 00:02:32.875 SYMLINK libspdk_event_scheduler.so 00:02:32.875 SYMLINK libspdk_event_iobuf.so 00:02:33.134 CC module/event/subsystems/accel/accel.o 00:02:33.134 LIB libspdk_event_accel.a 00:02:33.134 SO libspdk_event_accel.so.6.0 00:02:33.394 SYMLINK libspdk_event_accel.so 00:02:33.653 CC module/event/subsystems/bdev/bdev.o 00:02:33.653 LIB libspdk_event_bdev.a 00:02:33.653 SO libspdk_event_bdev.so.6.0 00:02:33.912 SYMLINK libspdk_event_bdev.so 00:02:34.171 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:34.171 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:34.171 CC module/event/subsystems/ublk/ublk.o 00:02:34.171 CC module/event/subsystems/nbd/nbd.o 00:02:34.171 CC module/event/subsystems/scsi/scsi.o 00:02:34.171 LIB libspdk_event_ublk.a 00:02:34.171 LIB libspdk_event_nbd.a 00:02:34.171 LIB libspdk_event_scsi.a 00:02:34.171 SO libspdk_event_ublk.so.3.0 00:02:34.171 LIB libspdk_event_nvmf.a 00:02:34.171 SO libspdk_event_nbd.so.6.0 00:02:34.171 SO libspdk_event_scsi.so.6.0 00:02:34.431 SO libspdk_event_nvmf.so.6.0 00:02:34.431 SYMLINK libspdk_event_ublk.so 00:02:34.431 SYMLINK libspdk_event_nbd.so 00:02:34.431 SYMLINK libspdk_event_scsi.so 00:02:34.431 SYMLINK libspdk_event_nvmf.so 00:02:34.691 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:34.691 CC module/event/subsystems/iscsi/iscsi.o 00:02:34.691 LIB libspdk_event_vhost_scsi.a 00:02:34.691 LIB libspdk_event_iscsi.a 00:02:34.691 SO libspdk_event_vhost_scsi.so.3.0 00:02:34.691 SO libspdk_event_iscsi.so.6.0 00:02:34.950 SYMLINK libspdk_event_vhost_scsi.so 00:02:34.950 SYMLINK libspdk_event_iscsi.so 00:02:34.950 SO libspdk.so.6.0 00:02:34.950 SYMLINK libspdk.so 00:02:35.208 CC app/spdk_nvme_perf/perf.o 00:02:35.208 CXX app/trace/trace.o 00:02:35.208 CC app/spdk_top/spdk_top.o 00:02:35.208 CC app/trace_record/trace_record.o 00:02:35.208 CC app/spdk_nvme_identify/identify.o 00:02:35.208 CC app/spdk_lspci/spdk_lspci.o 00:02:35.208 CC app/spdk_nvme_discover/discovery_aer.o 00:02:35.478 CC app/spdk_dd/spdk_dd.o 00:02:35.478 CC app/nvmf_tgt/nvmf_main.o 00:02:35.478 TEST_HEADER include/spdk/assert.h 00:02:35.478 TEST_HEADER include/spdk/accel_module.h 00:02:35.478 CC test/rpc_client/rpc_client_test.o 00:02:35.478 TEST_HEADER include/spdk/accel.h 00:02:35.478 TEST_HEADER include/spdk/barrier.h 00:02:35.478 TEST_HEADER include/spdk/bdev.h 00:02:35.478 TEST_HEADER include/spdk/base64.h 00:02:35.478 TEST_HEADER include/spdk/bdev_module.h 00:02:35.478 TEST_HEADER include/spdk/bdev_zone.h 00:02:35.478 TEST_HEADER include/spdk/bit_array.h 00:02:35.478 TEST_HEADER include/spdk/bit_pool.h 00:02:35.478 TEST_HEADER include/spdk/blob_bdev.h 00:02:35.478 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:35.478 TEST_HEADER include/spdk/blobfs.h 00:02:35.478 TEST_HEADER include/spdk/blob.h 00:02:35.478 TEST_HEADER include/spdk/conf.h 00:02:35.478 TEST_HEADER include/spdk/cpuset.h 00:02:35.478 TEST_HEADER include/spdk/config.h 00:02:35.478 TEST_HEADER include/spdk/crc16.h 00:02:35.478 TEST_HEADER include/spdk/crc64.h 00:02:35.478 TEST_HEADER include/spdk/crc32.h 00:02:35.478 TEST_HEADER include/spdk/dif.h 00:02:35.478 TEST_HEADER include/spdk/dma.h 00:02:35.478 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:35.478 TEST_HEADER include/spdk/endian.h 00:02:35.478 TEST_HEADER include/spdk/env_dpdk.h 00:02:35.478 TEST_HEADER include/spdk/event.h 00:02:35.478 TEST_HEADER include/spdk/env.h 00:02:35.478 TEST_HEADER include/spdk/fd_group.h 00:02:35.478 CC app/vhost/vhost.o 00:02:35.478 TEST_HEADER include/spdk/file.h 00:02:35.478 TEST_HEADER include/spdk/fd.h 00:02:35.478 TEST_HEADER include/spdk/gpt_spec.h 00:02:35.478 TEST_HEADER include/spdk/ftl.h 00:02:35.478 TEST_HEADER include/spdk/hexlify.h 00:02:35.478 TEST_HEADER include/spdk/histogram_data.h 00:02:35.478 CC app/iscsi_tgt/iscsi_tgt.o 00:02:35.478 TEST_HEADER include/spdk/idxd.h 00:02:35.478 TEST_HEADER include/spdk/ioat.h 00:02:35.478 TEST_HEADER include/spdk/idxd_spec.h 00:02:35.478 TEST_HEADER include/spdk/ioat_spec.h 00:02:35.478 TEST_HEADER include/spdk/init.h 00:02:35.478 TEST_HEADER include/spdk/iscsi_spec.h 00:02:35.478 TEST_HEADER include/spdk/json.h 00:02:35.478 TEST_HEADER include/spdk/jsonrpc.h 00:02:35.478 TEST_HEADER include/spdk/keyring.h 00:02:35.478 TEST_HEADER include/spdk/keyring_module.h 00:02:35.478 TEST_HEADER include/spdk/likely.h 00:02:35.478 TEST_HEADER include/spdk/log.h 00:02:35.478 TEST_HEADER include/spdk/lvol.h 00:02:35.478 TEST_HEADER include/spdk/mmio.h 00:02:35.478 TEST_HEADER include/spdk/nbd.h 00:02:35.478 TEST_HEADER include/spdk/memory.h 00:02:35.478 TEST_HEADER include/spdk/notify.h 00:02:35.478 TEST_HEADER include/spdk/nvme_intel.h 00:02:35.478 TEST_HEADER include/spdk/nvme.h 00:02:35.478 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:35.478 TEST_HEADER include/spdk/nvme_spec.h 00:02:35.478 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:35.478 TEST_HEADER include/spdk/nvme_zns.h 00:02:35.478 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:35.478 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:35.478 TEST_HEADER include/spdk/nvmf.h 00:02:35.478 TEST_HEADER include/spdk/nvmf_spec.h 00:02:35.478 TEST_HEADER include/spdk/opal.h 00:02:35.478 TEST_HEADER include/spdk/nvmf_transport.h 00:02:35.478 CC app/spdk_tgt/spdk_tgt.o 00:02:35.478 TEST_HEADER include/spdk/opal_spec.h 00:02:35.478 TEST_HEADER include/spdk/pci_ids.h 00:02:35.478 TEST_HEADER include/spdk/pipe.h 00:02:35.478 TEST_HEADER include/spdk/queue.h 00:02:35.478 TEST_HEADER include/spdk/rpc.h 00:02:35.478 TEST_HEADER include/spdk/reduce.h 00:02:35.478 TEST_HEADER include/spdk/scheduler.h 00:02:35.478 TEST_HEADER include/spdk/scsi.h 00:02:35.478 TEST_HEADER include/spdk/scsi_spec.h 00:02:35.478 TEST_HEADER include/spdk/stdinc.h 00:02:35.478 TEST_HEADER include/spdk/sock.h 00:02:35.478 TEST_HEADER include/spdk/string.h 00:02:35.478 TEST_HEADER include/spdk/thread.h 00:02:35.478 TEST_HEADER include/spdk/trace.h 00:02:35.478 TEST_HEADER include/spdk/trace_parser.h 00:02:35.478 TEST_HEADER include/spdk/ublk.h 00:02:35.478 TEST_HEADER include/spdk/tree.h 00:02:35.478 TEST_HEADER include/spdk/uuid.h 00:02:35.478 TEST_HEADER include/spdk/util.h 00:02:35.478 TEST_HEADER include/spdk/version.h 00:02:35.478 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:35.478 TEST_HEADER include/spdk/vhost.h 00:02:35.478 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:35.478 TEST_HEADER include/spdk/vmd.h 00:02:35.478 TEST_HEADER include/spdk/xor.h 00:02:35.478 TEST_HEADER include/spdk/zipf.h 00:02:35.478 CXX test/cpp_headers/accel.o 00:02:35.478 CXX test/cpp_headers/assert.o 00:02:35.478 CXX test/cpp_headers/accel_module.o 00:02:35.478 CXX test/cpp_headers/barrier.o 00:02:35.478 CXX test/cpp_headers/bdev_module.o 00:02:35.478 CXX test/cpp_headers/base64.o 00:02:35.478 CXX test/cpp_headers/bdev_zone.o 00:02:35.478 CXX test/cpp_headers/bdev.o 00:02:35.478 CXX test/cpp_headers/bit_array.o 00:02:35.478 CXX test/cpp_headers/bit_pool.o 00:02:35.478 CXX test/cpp_headers/blob_bdev.o 00:02:35.478 CXX test/cpp_headers/blobfs_bdev.o 00:02:35.478 CXX test/cpp_headers/config.o 00:02:35.478 CXX test/cpp_headers/conf.o 00:02:35.478 CXX test/cpp_headers/blobfs.o 00:02:35.478 CXX test/cpp_headers/crc16.o 00:02:35.478 CXX test/cpp_headers/blob.o 00:02:35.478 CXX test/cpp_headers/crc32.o 00:02:35.478 CXX test/cpp_headers/crc64.o 00:02:35.478 CXX test/cpp_headers/cpuset.o 00:02:35.478 CXX test/cpp_headers/dma.o 00:02:35.478 CXX test/cpp_headers/dif.o 00:02:35.478 CXX test/cpp_headers/endian.o 00:02:35.478 CXX test/cpp_headers/env.o 00:02:35.478 CXX test/cpp_headers/env_dpdk.o 00:02:35.478 CXX test/cpp_headers/fd_group.o 00:02:35.478 CXX test/cpp_headers/file.o 00:02:35.478 CXX test/cpp_headers/event.o 00:02:35.478 CXX test/cpp_headers/ftl.o 00:02:35.479 CXX test/cpp_headers/fd.o 00:02:35.479 CXX test/cpp_headers/gpt_spec.o 00:02:35.479 CXX test/cpp_headers/hexlify.o 00:02:35.479 CXX test/cpp_headers/histogram_data.o 00:02:35.479 CXX test/cpp_headers/idxd.o 00:02:35.479 CXX test/cpp_headers/idxd_spec.o 00:02:35.479 CXX test/cpp_headers/init.o 00:02:35.479 CXX test/cpp_headers/ioat.o 00:02:35.479 CC examples/nvme/reconnect/reconnect.o 00:02:35.479 CC examples/nvme/hotplug/hotplug.o 00:02:35.479 CC examples/nvme/hello_world/hello_world.o 00:02:35.479 CC examples/ioat/perf/perf.o 00:02:35.479 CC examples/vmd/lsvmd/lsvmd.o 00:02:35.479 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:35.479 CXX test/cpp_headers/ioat_spec.o 00:02:35.479 CC examples/nvme/abort/abort.o 00:02:35.479 CC examples/accel/perf/accel_perf.o 00:02:35.479 CC test/nvme/aer/aer.o 00:02:35.479 CC test/event/reactor/reactor.o 00:02:35.479 CC test/nvme/boot_partition/boot_partition.o 00:02:35.479 CC examples/vmd/led/led.o 00:02:35.479 CC examples/idxd/perf/perf.o 00:02:35.751 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:35.751 CC examples/nvme/arbitration/arbitration.o 00:02:35.751 CC test/event/event_perf/event_perf.o 00:02:35.751 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:35.752 CC test/nvme/cuse/cuse.o 00:02:35.752 CC test/nvme/compliance/nvme_compliance.o 00:02:35.752 CC test/event/reactor_perf/reactor_perf.o 00:02:35.752 CC test/nvme/e2edp/nvme_dp.o 00:02:35.752 CC test/thread/poller_perf/poller_perf.o 00:02:35.752 CC examples/sock/hello_world/hello_sock.o 00:02:35.752 CC test/nvme/startup/startup.o 00:02:35.752 CC test/nvme/simple_copy/simple_copy.o 00:02:35.752 CC test/nvme/connect_stress/connect_stress.o 00:02:35.752 CC app/fio/nvme/fio_plugin.o 00:02:35.752 CC examples/bdev/hello_world/hello_bdev.o 00:02:35.752 CC test/nvme/reset/reset.o 00:02:35.752 CC test/blobfs/mkfs/mkfs.o 00:02:35.752 CC test/app/histogram_perf/histogram_perf.o 00:02:35.752 CC test/nvme/overhead/overhead.o 00:02:35.752 CC test/nvme/err_injection/err_injection.o 00:02:35.752 CC test/app/jsoncat/jsoncat.o 00:02:35.752 CC examples/ioat/verify/verify.o 00:02:35.752 CC examples/blob/hello_world/hello_blob.o 00:02:35.752 CC test/dma/test_dma/test_dma.o 00:02:35.752 CC test/nvme/reserve/reserve.o 00:02:35.752 CC test/nvme/fused_ordering/fused_ordering.o 00:02:35.752 CC test/nvme/sgl/sgl.o 00:02:35.752 CC examples/nvmf/nvmf/nvmf.o 00:02:35.752 CC test/nvme/fdp/fdp.o 00:02:35.752 CC test/accel/dif/dif.o 00:02:35.752 CC test/event/app_repeat/app_repeat.o 00:02:35.752 CC test/app/stub/stub.o 00:02:35.752 CC app/fio/bdev/fio_plugin.o 00:02:35.752 CC test/app/bdev_svc/bdev_svc.o 00:02:35.752 CC test/env/vtophys/vtophys.o 00:02:35.752 CC examples/bdev/bdevperf/bdevperf.o 00:02:35.752 CC test/env/memory/memory_ut.o 00:02:35.752 CC test/env/pci/pci_ut.o 00:02:35.752 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:35.752 CC examples/util/zipf/zipf.o 00:02:35.752 CC test/event/scheduler/scheduler.o 00:02:35.752 CC test/bdev/bdevio/bdevio.o 00:02:35.752 CC examples/blob/cli/blobcli.o 00:02:35.752 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:35.752 CC examples/thread/thread/thread_ex.o 00:02:35.752 LINK spdk_lspci 00:02:35.752 LINK nvmf_tgt 00:02:35.752 LINK vhost 00:02:36.017 LINK spdk_trace_record 00:02:36.017 LINK iscsi_tgt 00:02:36.017 LINK lsvmd 00:02:36.017 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:36.017 CC test/lvol/esnap/esnap.o 00:02:36.017 LINK rpc_client_test 00:02:36.017 LINK led 00:02:36.017 LINK reactor_perf 00:02:36.017 LINK boot_partition 00:02:36.017 LINK reactor 00:02:36.017 CXX test/cpp_headers/iscsi_spec.o 00:02:36.017 CXX test/cpp_headers/json.o 00:02:36.017 CXX test/cpp_headers/jsonrpc.o 00:02:36.017 CXX test/cpp_headers/keyring.o 00:02:36.017 LINK spdk_nvme_discover 00:02:36.017 CXX test/cpp_headers/keyring_module.o 00:02:36.017 CXX test/cpp_headers/likely.o 00:02:36.017 LINK jsoncat 00:02:36.017 CXX test/cpp_headers/log.o 00:02:36.017 CXX test/cpp_headers/lvol.o 00:02:36.017 CXX test/cpp_headers/memory.o 00:02:36.017 CXX test/cpp_headers/mmio.o 00:02:36.017 LINK interrupt_tgt 00:02:36.017 LINK cmb_copy 00:02:36.017 CXX test/cpp_headers/nbd.o 00:02:36.017 CXX test/cpp_headers/nvme.o 00:02:36.017 CXX test/cpp_headers/notify.o 00:02:36.017 CXX test/cpp_headers/nvme_intel.o 00:02:36.017 CXX test/cpp_headers/nvme_ocssd.o 00:02:36.017 LINK vtophys 00:02:36.017 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:36.017 LINK err_injection 00:02:36.017 CXX test/cpp_headers/nvme_spec.o 00:02:36.277 CC test/env/mem_callbacks/mem_callbacks.o 00:02:36.277 CXX test/cpp_headers/nvme_zns.o 00:02:36.277 CXX test/cpp_headers/nvmf_cmd.o 00:02:36.277 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:36.278 LINK ioat_perf 00:02:36.278 LINK hotplug 00:02:36.278 LINK verify 00:02:36.278 LINK event_perf 00:02:36.278 LINK poller_perf 00:02:36.278 LINK reset 00:02:36.278 LINK aer 00:02:36.278 LINK hello_blob 00:02:36.278 LINK spdk_tgt 00:02:36.278 LINK histogram_perf 00:02:36.278 LINK startup 00:02:36.278 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:36.278 CXX test/cpp_headers/nvmf.o 00:02:36.278 LINK pmr_persistence 00:02:36.278 LINK app_repeat 00:02:36.278 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:36.278 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:36.278 CXX test/cpp_headers/nvmf_spec.o 00:02:36.278 LINK zipf 00:02:36.278 LINK stub 00:02:36.278 LINK connect_stress 00:02:36.278 CXX test/cpp_headers/nvmf_transport.o 00:02:36.278 LINK idxd_perf 00:02:36.278 LINK reconnect 00:02:36.278 CXX test/cpp_headers/opal.o 00:02:36.278 CXX test/cpp_headers/pci_ids.o 00:02:36.278 LINK env_dpdk_post_init 00:02:36.278 CXX test/cpp_headers/opal_spec.o 00:02:36.278 LINK bdev_svc 00:02:36.278 LINK mkfs 00:02:36.278 LINK fused_ordering 00:02:36.278 CXX test/cpp_headers/pipe.o 00:02:36.278 CXX test/cpp_headers/queue.o 00:02:36.278 CXX test/cpp_headers/reduce.o 00:02:36.278 CXX test/cpp_headers/scheduler.o 00:02:36.278 CXX test/cpp_headers/rpc.o 00:02:36.278 CXX test/cpp_headers/scsi_spec.o 00:02:36.278 CXX test/cpp_headers/scsi.o 00:02:36.278 LINK hello_world 00:02:36.278 CXX test/cpp_headers/sock.o 00:02:36.278 LINK abort 00:02:36.278 LINK doorbell_aers 00:02:36.278 CXX test/cpp_headers/string.o 00:02:36.278 CXX test/cpp_headers/stdinc.o 00:02:36.278 LINK hello_bdev 00:02:36.278 LINK simple_copy 00:02:36.278 LINK reserve 00:02:36.278 LINK scheduler 00:02:36.278 CXX test/cpp_headers/thread.o 00:02:36.278 LINK hello_sock 00:02:36.278 CXX test/cpp_headers/trace.o 00:02:36.278 CXX test/cpp_headers/trace_parser.o 00:02:36.278 LINK spdk_dd 00:02:36.278 CXX test/cpp_headers/tree.o 00:02:36.278 CXX test/cpp_headers/ublk.o 00:02:36.278 CXX test/cpp_headers/uuid.o 00:02:36.538 CXX test/cpp_headers/util.o 00:02:36.538 CXX test/cpp_headers/version.o 00:02:36.538 CXX test/cpp_headers/vfio_user_pci.o 00:02:36.538 LINK nvme_dp 00:02:36.538 CXX test/cpp_headers/vfio_user_spec.o 00:02:36.538 CXX test/cpp_headers/vhost.o 00:02:36.538 LINK accel_perf 00:02:36.538 LINK test_dma 00:02:36.538 CXX test/cpp_headers/vmd.o 00:02:36.538 LINK sgl 00:02:36.538 CXX test/cpp_headers/xor.o 00:02:36.538 LINK nvme_compliance 00:02:36.538 LINK thread 00:02:36.538 LINK overhead 00:02:36.538 LINK pci_ut 00:02:36.538 CXX test/cpp_headers/zipf.o 00:02:36.538 LINK nvme_manage 00:02:36.538 LINK bdevio 00:02:36.538 LINK nvmf 00:02:36.538 LINK arbitration 00:02:36.538 LINK fdp 00:02:36.538 LINK spdk_trace 00:02:36.538 LINK blobcli 00:02:36.538 LINK nvme_fuzz 00:02:36.538 LINK dif 00:02:36.797 LINK spdk_nvme_perf 00:02:36.797 LINK spdk_nvme_identify 00:02:36.797 LINK spdk_top 00:02:36.797 LINK spdk_nvme 00:02:36.797 LINK spdk_bdev 00:02:36.797 LINK bdevperf 00:02:37.056 LINK vhost_fuzz 00:02:37.056 LINK mem_callbacks 00:02:37.056 LINK cuse 00:02:37.056 LINK memory_ut 00:02:37.624 LINK iscsi_fuzz 00:02:39.530 LINK esnap 00:02:39.530 00:02:39.530 real 0m40.148s 00:02:39.530 user 5m47.797s 00:02:39.530 sys 3m43.014s 00:02:39.530 21:03:33 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:39.530 21:03:33 -- common/autotest_common.sh@10 -- $ set +x 00:02:39.530 ************************************ 00:02:39.530 END TEST make 00:02:39.530 ************************************ 00:02:39.530 21:03:33 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:39.530 21:03:33 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:39.530 21:03:33 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:39.530 21:03:33 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.530 21:03:33 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:39.530 21:03:33 -- pm/common@45 -- $ pid=1037420 00:02:39.530 21:03:33 -- pm/common@52 -- $ sudo kill -TERM 1037420 00:02:39.531 21:03:33 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.531 21:03:33 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:39.531 21:03:33 -- pm/common@45 -- $ pid=1037425 00:02:39.531 21:03:33 -- pm/common@52 -- $ sudo kill -TERM 1037425 00:02:39.531 21:03:33 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.531 21:03:33 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:39.531 21:03:33 -- pm/common@45 -- $ pid=1037428 00:02:39.531 21:03:33 -- pm/common@52 -- $ sudo kill -TERM 1037428 00:02:39.531 21:03:33 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.531 21:03:33 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:39.531 21:03:33 -- pm/common@45 -- $ pid=1037429 00:02:39.531 21:03:33 -- pm/common@52 -- $ sudo kill -TERM 1037429 00:02:39.790 21:03:33 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:02:39.790 21:03:33 -- nvmf/common.sh@7 -- # uname -s 00:02:39.790 21:03:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:39.790 21:03:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:39.790 21:03:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:39.790 21:03:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:39.790 21:03:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:39.790 21:03:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:39.790 21:03:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:39.790 21:03:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:39.790 21:03:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:39.790 21:03:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:39.790 21:03:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:02:39.790 21:03:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:02:39.790 21:03:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:39.790 21:03:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:39.790 21:03:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:39.790 21:03:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:39.790 21:03:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:02:39.790 21:03:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:39.790 21:03:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:39.790 21:03:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:39.790 21:03:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.791 21:03:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.791 21:03:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.791 21:03:33 -- paths/export.sh@5 -- # export PATH 00:02:39.791 21:03:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:39.791 21:03:33 -- nvmf/common.sh@47 -- # : 0 00:02:39.791 21:03:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:39.791 21:03:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:39.791 21:03:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:39.791 21:03:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:39.791 21:03:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:39.791 21:03:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:39.791 21:03:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:39.791 21:03:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:39.791 21:03:33 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:39.791 21:03:33 -- spdk/autotest.sh@32 -- # uname -s 00:02:39.791 21:03:33 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:39.791 21:03:33 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:39.791 21:03:33 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:39.791 21:03:33 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:39.791 21:03:33 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:39.791 21:03:33 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:39.791 21:03:33 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:39.791 21:03:33 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:39.791 21:03:33 -- spdk/autotest.sh@48 -- # udevadm_pid=1096312 00:02:39.791 21:03:33 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:39.791 21:03:33 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:39.791 21:03:33 -- pm/common@17 -- # local monitor 00:02:39.791 21:03:33 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.791 21:03:33 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1096314 00:02:39.791 21:03:33 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.791 21:03:33 -- pm/common@21 -- # date +%s 00:02:39.791 21:03:33 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1096317 00:02:39.791 21:03:33 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.791 21:03:33 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1096320 00:02:39.791 21:03:33 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713899013 00:02:39.791 21:03:33 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:39.791 21:03:33 -- pm/common@21 -- # date +%s 00:02:39.791 21:03:33 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=1096323 00:02:39.791 21:03:33 -- pm/common@21 -- # date +%s 00:02:39.791 21:03:33 -- pm/common@26 -- # sleep 1 00:02:39.791 21:03:33 -- pm/common@21 -- # date +%s 00:02:39.791 21:03:33 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713899013 00:02:39.791 21:03:33 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713899013 00:02:39.791 21:03:33 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713899013 00:02:39.791 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713899013_collect-cpu-load.pm.log 00:02:39.791 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713899013_collect-vmstat.pm.log 00:02:39.791 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713899013_collect-bmc-pm.bmc.pm.log 00:02:39.791 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713899013_collect-cpu-temp.pm.log 00:02:40.730 21:03:34 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:40.730 21:03:34 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:40.730 21:03:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:40.730 21:03:34 -- common/autotest_common.sh@10 -- # set +x 00:02:40.730 21:03:34 -- spdk/autotest.sh@59 -- # create_test_list 00:02:40.730 21:03:34 -- common/autotest_common.sh@734 -- # xtrace_disable 00:02:40.730 21:03:34 -- common/autotest_common.sh@10 -- # set +x 00:02:40.730 21:03:34 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:02:40.730 21:03:34 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:40.730 21:03:34 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:40.730 21:03:34 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:02:40.730 21:03:34 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:40.730 21:03:34 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:40.730 21:03:34 -- common/autotest_common.sh@1441 -- # uname 00:02:40.731 21:03:34 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:02:40.731 21:03:34 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:40.731 21:03:34 -- common/autotest_common.sh@1461 -- # uname 00:02:40.731 21:03:34 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:02:40.731 21:03:34 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:40.731 21:03:34 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:40.731 21:03:34 -- spdk/autotest.sh@72 -- # hash lcov 00:02:40.731 21:03:34 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:40.731 21:03:34 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:40.731 --rc lcov_branch_coverage=1 00:02:40.731 --rc lcov_function_coverage=1 00:02:40.731 --rc genhtml_branch_coverage=1 00:02:40.731 --rc genhtml_function_coverage=1 00:02:40.731 --rc genhtml_legend=1 00:02:40.731 --rc geninfo_all_blocks=1 00:02:40.731 ' 00:02:40.731 21:03:34 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:40.731 --rc lcov_branch_coverage=1 00:02:40.731 --rc lcov_function_coverage=1 00:02:40.731 --rc genhtml_branch_coverage=1 00:02:40.731 --rc genhtml_function_coverage=1 00:02:40.731 --rc genhtml_legend=1 00:02:40.731 --rc geninfo_all_blocks=1 00:02:40.731 ' 00:02:40.731 21:03:34 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:40.731 --rc lcov_branch_coverage=1 00:02:40.731 --rc lcov_function_coverage=1 00:02:40.731 --rc genhtml_branch_coverage=1 00:02:40.731 --rc genhtml_function_coverage=1 00:02:40.731 --rc genhtml_legend=1 00:02:40.731 --rc geninfo_all_blocks=1 00:02:40.731 --no-external' 00:02:40.731 21:03:34 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:40.731 --rc lcov_branch_coverage=1 00:02:40.731 --rc lcov_function_coverage=1 00:02:40.731 --rc genhtml_branch_coverage=1 00:02:40.731 --rc genhtml_function_coverage=1 00:02:40.731 --rc genhtml_legend=1 00:02:40.731 --rc geninfo_all_blocks=1 00:02:40.731 --no-external' 00:02:40.731 21:03:34 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:40.990 lcov: LCOV version 1.14 00:02:40.990 21:03:35 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:46.301 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:46.302 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:46.302 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:46.302 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:46.302 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:46.302 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:51.570 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:51.570 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:59.687 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:59.687 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:59.688 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:59.688 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:59.689 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:59.689 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:03:01.679 21:03:55 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:03:01.679 21:03:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:01.679 21:03:55 -- common/autotest_common.sh@10 -- # set +x 00:03:01.679 21:03:55 -- spdk/autotest.sh@91 -- # rm -f 00:03:01.679 21:03:55 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:04.968 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:03:04.968 0000:d8:00.0 (8086 0a54): Already using the nvme driver 00:03:05.902 21:04:00 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:03:05.902 21:04:00 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:05.902 21:04:00 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:05.902 21:04:00 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:05.902 21:04:00 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:05.902 21:04:00 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:05.902 21:04:00 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:05.902 21:04:00 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:05.902 21:04:00 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:05.902 21:04:00 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:03:05.902 21:04:00 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:03:05.902 21:04:00 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:03:05.902 21:04:00 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:03:05.902 21:04:00 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:03:05.902 21:04:00 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:05.902 No valid GPT data, bailing 00:03:05.902 21:04:00 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:05.902 21:04:00 -- scripts/common.sh@391 -- # pt= 00:03:05.902 21:04:00 -- scripts/common.sh@392 -- # return 1 00:03:05.902 21:04:00 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:06.161 1+0 records in 00:03:06.161 1+0 records out 00:03:06.161 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00454424 s, 231 MB/s 00:03:06.161 21:04:00 -- spdk/autotest.sh@118 -- # sync 00:03:06.161 21:04:00 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:06.161 21:04:00 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:06.161 21:04:00 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:12.723 21:04:05 -- spdk/autotest.sh@124 -- # uname -s 00:03:12.723 21:04:05 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:03:12.723 21:04:05 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:03:12.723 21:04:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.723 21:04:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.723 21:04:05 -- common/autotest_common.sh@10 -- # set +x 00:03:12.723 ************************************ 00:03:12.723 START TEST setup.sh 00:03:12.723 ************************************ 00:03:12.723 21:04:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:03:12.723 * Looking for test storage... 00:03:12.723 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:12.723 21:04:06 -- setup/test-setup.sh@10 -- # uname -s 00:03:12.723 21:04:06 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:12.723 21:04:06 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:03:12.723 21:04:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.723 21:04:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.723 21:04:06 -- common/autotest_common.sh@10 -- # set +x 00:03:12.723 ************************************ 00:03:12.723 START TEST acl 00:03:12.723 ************************************ 00:03:12.723 21:04:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:03:12.723 * Looking for test storage... 00:03:12.723 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:12.723 21:04:06 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:12.723 21:04:06 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:12.723 21:04:06 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:12.723 21:04:06 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:12.723 21:04:06 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:12.723 21:04:06 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:12.723 21:04:06 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:12.723 21:04:06 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:12.723 21:04:06 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:12.723 21:04:06 -- setup/acl.sh@12 -- # devs=() 00:03:12.723 21:04:06 -- setup/acl.sh@12 -- # declare -a devs 00:03:12.723 21:04:06 -- setup/acl.sh@13 -- # drivers=() 00:03:12.723 21:04:06 -- setup/acl.sh@13 -- # declare -A drivers 00:03:12.723 21:04:06 -- setup/acl.sh@51 -- # setup reset 00:03:12.723 21:04:06 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:12.723 21:04:06 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:16.917 21:04:10 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:16.917 21:04:10 -- setup/acl.sh@16 -- # local dev driver 00:03:16.917 21:04:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:16.917 21:04:10 -- setup/acl.sh@15 -- # setup output status 00:03:16.917 21:04:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.917 21:04:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:03:19.454 Hugepages 00:03:19.454 node hugesize free / total 00:03:19.454 21:04:13 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:19.454 21:04:13 -- setup/acl.sh@19 -- # continue 00:03:19.454 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.454 21:04:13 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:19.454 21:04:13 -- setup/acl.sh@19 -- # continue 00:03:19.454 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 00:03:19.455 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # continue 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@19 -- # [[ 0000:d8:00.0 == *:*:*.* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:19.455 21:04:13 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\d\8\:\0\0\.\0* ]] 00:03:19.455 21:04:13 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:19.455 21:04:13 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:19.455 21:04:13 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:19.455 21:04:13 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:19.455 21:04:13 -- setup/acl.sh@54 -- # run_test denied denied 00:03:19.455 21:04:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.455 21:04:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.455 21:04:13 -- common/autotest_common.sh@10 -- # set +x 00:03:19.455 ************************************ 00:03:19.455 START TEST denied 00:03:19.455 ************************************ 00:03:19.455 21:04:13 -- common/autotest_common.sh@1111 -- # denied 00:03:19.455 21:04:13 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:d8:00.0' 00:03:19.455 21:04:13 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:d8:00.0' 00:03:19.455 21:04:13 -- setup/acl.sh@38 -- # setup output config 00:03:19.455 21:04:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.455 21:04:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:22.743 0000:d8:00.0 (8086 0a54): Skipping denied controller at 0000:d8:00.0 00:03:22.743 21:04:16 -- setup/acl.sh@40 -- # verify 0000:d8:00.0 00:03:22.743 21:04:16 -- setup/acl.sh@28 -- # local dev driver 00:03:22.743 21:04:16 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:22.743 21:04:16 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:d8:00.0 ]] 00:03:22.743 21:04:16 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:d8:00.0/driver 00:03:22.743 21:04:16 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:22.743 21:04:16 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:22.743 21:04:16 -- setup/acl.sh@41 -- # setup reset 00:03:22.743 21:04:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.743 21:04:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:28.012 00:03:28.012 real 0m8.358s 00:03:28.012 user 0m2.479s 00:03:28.012 sys 0m4.997s 00:03:28.012 21:04:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:28.012 21:04:21 -- common/autotest_common.sh@10 -- # set +x 00:03:28.012 ************************************ 00:03:28.012 END TEST denied 00:03:28.012 ************************************ 00:03:28.012 21:04:21 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:28.012 21:04:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.012 21:04:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.012 21:04:21 -- common/autotest_common.sh@10 -- # set +x 00:03:28.012 ************************************ 00:03:28.012 START TEST allowed 00:03:28.012 ************************************ 00:03:28.012 21:04:21 -- common/autotest_common.sh@1111 -- # allowed 00:03:28.012 21:04:21 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:d8:00.0 00:03:28.012 21:04:21 -- setup/acl.sh@46 -- # grep -E '0000:d8:00.0 .*: nvme -> .*' 00:03:28.012 21:04:21 -- setup/acl.sh@45 -- # setup output config 00:03:28.012 21:04:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.012 21:04:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:36.161 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:03:36.161 21:04:28 -- setup/acl.sh@47 -- # verify 00:03:36.161 21:04:28 -- setup/acl.sh@28 -- # local dev driver 00:03:36.161 21:04:28 -- setup/acl.sh@48 -- # setup reset 00:03:36.161 21:04:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:36.161 21:04:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:39.445 00:03:39.445 real 0m11.006s 00:03:39.445 user 0m2.561s 00:03:39.445 sys 0m5.032s 00:03:39.445 21:04:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:39.445 21:04:32 -- common/autotest_common.sh@10 -- # set +x 00:03:39.445 ************************************ 00:03:39.445 END TEST allowed 00:03:39.445 ************************************ 00:03:39.445 00:03:39.445 real 0m26.764s 00:03:39.445 user 0m7.717s 00:03:39.445 sys 0m14.885s 00:03:39.445 21:04:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:39.445 21:04:33 -- common/autotest_common.sh@10 -- # set +x 00:03:39.445 ************************************ 00:03:39.445 END TEST acl 00:03:39.445 ************************************ 00:03:39.445 21:04:33 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:39.445 21:04:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.445 21:04:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.445 21:04:33 -- common/autotest_common.sh@10 -- # set +x 00:03:39.445 ************************************ 00:03:39.445 START TEST hugepages 00:03:39.445 ************************************ 00:03:39.445 21:04:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:39.445 * Looking for test storage... 00:03:39.445 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:39.445 21:04:33 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:39.445 21:04:33 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:39.445 21:04:33 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:39.445 21:04:33 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:39.445 21:04:33 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:39.445 21:04:33 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:39.445 21:04:33 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:39.445 21:04:33 -- setup/common.sh@18 -- # local node= 00:03:39.445 21:04:33 -- setup/common.sh@19 -- # local var val 00:03:39.445 21:04:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:39.445 21:04:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:39.445 21:04:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:39.445 21:04:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:39.445 21:04:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:39.445 21:04:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.445 21:04:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 75362548 kB' 'MemAvailable: 79488148 kB' 'Buffers: 4988 kB' 'Cached: 10671308 kB' 'SwapCached: 0 kB' 'Active: 7848160 kB' 'Inactive: 3436156 kB' 'Active(anon): 6694804 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 611788 kB' 'Mapped: 208996 kB' 'Shmem: 6086784 kB' 'KReclaimable: 264564 kB' 'Slab: 832736 kB' 'SReclaimable: 264564 kB' 'SUnreclaim: 568172 kB' 'KernelStack: 22864 kB' 'PageTables: 9424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52949048 kB' 'Committed_AS: 8148112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218256 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.445 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.445 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.446 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.446 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # continue 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:39.447 21:04:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:39.447 21:04:33 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:39.447 21:04:33 -- setup/common.sh@33 -- # echo 2048 00:03:39.447 21:04:33 -- setup/common.sh@33 -- # return 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:39.447 21:04:33 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:39.447 21:04:33 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:39.447 21:04:33 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:39.447 21:04:33 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:39.447 21:04:33 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:39.447 21:04:33 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:39.447 21:04:33 -- setup/hugepages.sh@207 -- # get_nodes 00:03:39.447 21:04:33 -- setup/hugepages.sh@27 -- # local node 00:03:39.447 21:04:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:39.447 21:04:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:39.447 21:04:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:39.447 21:04:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:39.447 21:04:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:39.447 21:04:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:39.447 21:04:33 -- setup/hugepages.sh@208 -- # clear_hp 00:03:39.447 21:04:33 -- setup/hugepages.sh@37 -- # local node hp 00:03:39.447 21:04:33 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:39.447 21:04:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.447 21:04:33 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.447 21:04:33 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:39.447 21:04:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.447 21:04:33 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:39.447 21:04:33 -- setup/hugepages.sh@41 -- # echo 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:39.447 21:04:33 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:39.447 21:04:33 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:39.447 21:04:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.447 21:04:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.447 21:04:33 -- common/autotest_common.sh@10 -- # set +x 00:03:39.447 ************************************ 00:03:39.447 START TEST default_setup 00:03:39.447 ************************************ 00:03:39.447 21:04:33 -- common/autotest_common.sh@1111 -- # default_setup 00:03:39.447 21:04:33 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:39.447 21:04:33 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:39.447 21:04:33 -- setup/hugepages.sh@51 -- # shift 00:03:39.447 21:04:33 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:39.447 21:04:33 -- setup/hugepages.sh@52 -- # local node_ids 00:03:39.447 21:04:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:39.447 21:04:33 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:39.447 21:04:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:39.447 21:04:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:39.447 21:04:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:39.447 21:04:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:39.447 21:04:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:39.447 21:04:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:39.447 21:04:33 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:39.447 21:04:33 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:39.447 21:04:33 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:39.447 21:04:33 -- setup/hugepages.sh@73 -- # return 0 00:03:39.447 21:04:33 -- setup/hugepages.sh@137 -- # setup output 00:03:39.447 21:04:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.447 21:04:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:41.979 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:41.979 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:42.237 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:45.539 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:03:46.921 21:04:40 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:46.921 21:04:40 -- setup/hugepages.sh@89 -- # local node 00:03:46.921 21:04:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:46.921 21:04:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:46.921 21:04:40 -- setup/hugepages.sh@92 -- # local surp 00:03:46.921 21:04:40 -- setup/hugepages.sh@93 -- # local resv 00:03:46.921 21:04:40 -- setup/hugepages.sh@94 -- # local anon 00:03:46.921 21:04:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:46.921 21:04:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:46.921 21:04:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:46.921 21:04:40 -- setup/common.sh@18 -- # local node= 00:03:46.921 21:04:40 -- setup/common.sh@19 -- # local var val 00:03:46.921 21:04:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:46.921 21:04:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:46.921 21:04:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:46.921 21:04:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:46.921 21:04:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:46.921 21:04:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77528852 kB' 'MemAvailable: 81654000 kB' 'Buffers: 4988 kB' 'Cached: 10671484 kB' 'SwapCached: 0 kB' 'Active: 7868852 kB' 'Inactive: 3436156 kB' 'Active(anon): 6715496 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 632044 kB' 'Mapped: 209548 kB' 'Shmem: 6086960 kB' 'KReclaimable: 263660 kB' 'Slab: 830344 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566684 kB' 'KernelStack: 22944 kB' 'PageTables: 9484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8167948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218288 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.921 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.921 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:46.922 21:04:40 -- setup/common.sh@33 -- # echo 0 00:03:46.922 21:04:40 -- setup/common.sh@33 -- # return 0 00:03:46.922 21:04:40 -- setup/hugepages.sh@97 -- # anon=0 00:03:46.922 21:04:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:46.922 21:04:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:46.922 21:04:40 -- setup/common.sh@18 -- # local node= 00:03:46.922 21:04:40 -- setup/common.sh@19 -- # local var val 00:03:46.922 21:04:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:46.922 21:04:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:46.922 21:04:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:46.922 21:04:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:46.922 21:04:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:46.922 21:04:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.922 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.922 21:04:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77525428 kB' 'MemAvailable: 81650576 kB' 'Buffers: 4988 kB' 'Cached: 10671488 kB' 'SwapCached: 0 kB' 'Active: 7865844 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712488 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629056 kB' 'Mapped: 209432 kB' 'Shmem: 6086964 kB' 'KReclaimable: 263660 kB' 'Slab: 830308 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566648 kB' 'KernelStack: 22928 kB' 'PageTables: 9472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8164492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218304 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.922 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.923 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.923 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.924 21:04:40 -- setup/common.sh@33 -- # echo 0 00:03:46.924 21:04:40 -- setup/common.sh@33 -- # return 0 00:03:46.924 21:04:40 -- setup/hugepages.sh@99 -- # surp=0 00:03:46.924 21:04:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:46.924 21:04:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:46.924 21:04:40 -- setup/common.sh@18 -- # local node= 00:03:46.924 21:04:40 -- setup/common.sh@19 -- # local var val 00:03:46.924 21:04:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:46.924 21:04:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:46.924 21:04:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:46.924 21:04:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:46.924 21:04:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:46.924 21:04:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77529180 kB' 'MemAvailable: 81654328 kB' 'Buffers: 4988 kB' 'Cached: 10671500 kB' 'SwapCached: 0 kB' 'Active: 7865740 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712384 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628916 kB' 'Mapped: 209024 kB' 'Shmem: 6086976 kB' 'KReclaimable: 263660 kB' 'Slab: 830308 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566648 kB' 'KernelStack: 22912 kB' 'PageTables: 9412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8164504 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218288 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.924 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.924 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.925 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:46.925 21:04:40 -- setup/common.sh@33 -- # echo 0 00:03:46.925 21:04:40 -- setup/common.sh@33 -- # return 0 00:03:46.925 21:04:40 -- setup/hugepages.sh@100 -- # resv=0 00:03:46.925 21:04:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:46.925 nr_hugepages=1024 00:03:46.925 21:04:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:46.925 resv_hugepages=0 00:03:46.925 21:04:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:46.925 surplus_hugepages=0 00:03:46.925 21:04:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:46.925 anon_hugepages=0 00:03:46.925 21:04:40 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:46.925 21:04:40 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:46.925 21:04:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:46.925 21:04:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:46.925 21:04:40 -- setup/common.sh@18 -- # local node= 00:03:46.925 21:04:40 -- setup/common.sh@19 -- # local var val 00:03:46.925 21:04:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:46.925 21:04:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:46.925 21:04:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:46.925 21:04:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:46.925 21:04:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:46.925 21:04:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.925 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77530104 kB' 'MemAvailable: 81655252 kB' 'Buffers: 4988 kB' 'Cached: 10671516 kB' 'SwapCached: 0 kB' 'Active: 7865776 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712420 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628916 kB' 'Mapped: 209024 kB' 'Shmem: 6086992 kB' 'KReclaimable: 263660 kB' 'Slab: 830308 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566648 kB' 'KernelStack: 22912 kB' 'PageTables: 9412 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8164520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218288 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.926 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.926 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:46.927 21:04:40 -- setup/common.sh@33 -- # echo 1024 00:03:46.927 21:04:40 -- setup/common.sh@33 -- # return 0 00:03:46.927 21:04:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:46.927 21:04:40 -- setup/hugepages.sh@112 -- # get_nodes 00:03:46.927 21:04:40 -- setup/hugepages.sh@27 -- # local node 00:03:46.927 21:04:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:46.927 21:04:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:46.927 21:04:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:46.927 21:04:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:46.927 21:04:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:46.927 21:04:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:46.927 21:04:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:46.927 21:04:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:46.927 21:04:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:46.927 21:04:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:46.927 21:04:40 -- setup/common.sh@18 -- # local node=0 00:03:46.927 21:04:40 -- setup/common.sh@19 -- # local var val 00:03:46.927 21:04:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:46.927 21:04:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:46.927 21:04:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:46.927 21:04:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:46.927 21:04:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:46.927 21:04:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 26295900 kB' 'MemUsed: 6333112 kB' 'SwapCached: 0 kB' 'Active: 2533996 kB' 'Inactive: 173828 kB' 'Active(anon): 1915940 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2348944 kB' 'Mapped: 38384 kB' 'AnonPages: 362168 kB' 'Shmem: 1557060 kB' 'KernelStack: 12232 kB' 'PageTables: 4880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123520 kB' 'Slab: 445072 kB' 'SReclaimable: 123520 kB' 'SUnreclaim: 321552 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.927 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.927 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # continue 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:46.928 21:04:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:46.928 21:04:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:46.928 21:04:40 -- setup/common.sh@33 -- # echo 0 00:03:46.928 21:04:40 -- setup/common.sh@33 -- # return 0 00:03:46.928 21:04:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:46.928 21:04:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:46.928 21:04:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:46.928 21:04:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:46.928 21:04:40 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:46.928 node0=1024 expecting 1024 00:03:46.928 21:04:40 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:46.928 00:03:46.928 real 0m7.533s 00:03:46.928 user 0m1.596s 00:03:46.928 sys 0m2.675s 00:03:46.928 21:04:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:46.928 21:04:40 -- common/autotest_common.sh@10 -- # set +x 00:03:46.928 ************************************ 00:03:46.928 END TEST default_setup 00:03:46.928 ************************************ 00:03:46.928 21:04:41 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:46.928 21:04:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.928 21:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.928 21:04:41 -- common/autotest_common.sh@10 -- # set +x 00:03:46.928 ************************************ 00:03:46.928 START TEST per_node_1G_alloc 00:03:46.928 ************************************ 00:03:46.928 21:04:41 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:03:46.928 21:04:41 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:46.928 21:04:41 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:46.928 21:04:41 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:46.928 21:04:41 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:46.928 21:04:41 -- setup/hugepages.sh@51 -- # shift 00:03:46.928 21:04:41 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:46.928 21:04:41 -- setup/hugepages.sh@52 -- # local node_ids 00:03:46.928 21:04:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:46.928 21:04:41 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:46.928 21:04:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:46.928 21:04:41 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:46.928 21:04:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:46.928 21:04:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:46.928 21:04:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:46.928 21:04:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:46.928 21:04:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:46.928 21:04:41 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:46.928 21:04:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:46.928 21:04:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:46.928 21:04:41 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:46.928 21:04:41 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:46.928 21:04:41 -- setup/hugepages.sh@73 -- # return 0 00:03:46.928 21:04:41 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:46.928 21:04:41 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:46.928 21:04:41 -- setup/hugepages.sh@146 -- # setup output 00:03:46.928 21:04:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.928 21:04:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:49.461 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:49.461 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:49.461 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:49.461 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:49.461 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:49.719 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:49.719 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:49.719 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:49.719 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:49.719 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:49.720 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:51.097 21:04:45 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:51.097 21:04:45 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:51.097 21:04:45 -- setup/hugepages.sh@89 -- # local node 00:03:51.097 21:04:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:51.097 21:04:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:51.097 21:04:45 -- setup/hugepages.sh@92 -- # local surp 00:03:51.097 21:04:45 -- setup/hugepages.sh@93 -- # local resv 00:03:51.097 21:04:45 -- setup/hugepages.sh@94 -- # local anon 00:03:51.097 21:04:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:51.097 21:04:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:51.097 21:04:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:51.097 21:04:45 -- setup/common.sh@18 -- # local node= 00:03:51.097 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.097 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.097 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.097 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.097 21:04:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.097 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.097 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77514552 kB' 'MemAvailable: 81639700 kB' 'Buffers: 4988 kB' 'Cached: 10671624 kB' 'SwapCached: 0 kB' 'Active: 7865576 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712220 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628044 kB' 'Mapped: 208304 kB' 'Shmem: 6087100 kB' 'KReclaimable: 263660 kB' 'Slab: 830008 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566348 kB' 'KernelStack: 22896 kB' 'PageTables: 9320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218256 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.097 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.097 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:51.098 21:04:45 -- setup/common.sh@33 -- # echo 0 00:03:51.098 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.098 21:04:45 -- setup/hugepages.sh@97 -- # anon=0 00:03:51.098 21:04:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:51.098 21:04:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:51.098 21:04:45 -- setup/common.sh@18 -- # local node= 00:03:51.098 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.098 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.098 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.098 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.098 21:04:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.098 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.098 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77516624 kB' 'MemAvailable: 81641772 kB' 'Buffers: 4988 kB' 'Cached: 10671628 kB' 'SwapCached: 0 kB' 'Active: 7865388 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712032 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627848 kB' 'Mapped: 208292 kB' 'Shmem: 6087104 kB' 'KReclaimable: 263660 kB' 'Slab: 830008 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566348 kB' 'KernelStack: 22864 kB' 'PageTables: 9212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218224 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.098 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.098 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.099 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.099 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.100 21:04:45 -- setup/common.sh@33 -- # echo 0 00:03:51.100 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.100 21:04:45 -- setup/hugepages.sh@99 -- # surp=0 00:03:51.100 21:04:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:51.100 21:04:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:51.100 21:04:45 -- setup/common.sh@18 -- # local node= 00:03:51.100 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.100 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.100 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.100 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.100 21:04:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.100 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.100 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77515720 kB' 'MemAvailable: 81640868 kB' 'Buffers: 4988 kB' 'Cached: 10671636 kB' 'SwapCached: 0 kB' 'Active: 7864820 kB' 'Inactive: 3436156 kB' 'Active(anon): 6711464 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627700 kB' 'Mapped: 208216 kB' 'Shmem: 6087112 kB' 'KReclaimable: 263660 kB' 'Slab: 829984 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566324 kB' 'KernelStack: 22848 kB' 'PageTables: 9152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218240 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.100 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.100 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:51.101 21:04:45 -- setup/common.sh@33 -- # echo 0 00:03:51.101 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.101 21:04:45 -- setup/hugepages.sh@100 -- # resv=0 00:03:51.101 21:04:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:51.101 nr_hugepages=1024 00:03:51.101 21:04:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:51.101 resv_hugepages=0 00:03:51.101 21:04:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:51.101 surplus_hugepages=0 00:03:51.101 21:04:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:51.101 anon_hugepages=0 00:03:51.101 21:04:45 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:51.101 21:04:45 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:51.101 21:04:45 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:51.101 21:04:45 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:51.101 21:04:45 -- setup/common.sh@18 -- # local node= 00:03:51.101 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.101 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.101 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.101 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.101 21:04:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.101 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.101 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77516156 kB' 'MemAvailable: 81641304 kB' 'Buffers: 4988 kB' 'Cached: 10671652 kB' 'SwapCached: 0 kB' 'Active: 7865212 kB' 'Inactive: 3436156 kB' 'Active(anon): 6711856 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628164 kB' 'Mapped: 208216 kB' 'Shmem: 6087128 kB' 'KReclaimable: 263660 kB' 'Slab: 829984 kB' 'SReclaimable: 263660 kB' 'SUnreclaim: 566324 kB' 'KernelStack: 22896 kB' 'PageTables: 9340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218288 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.101 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.101 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.102 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.102 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:51.103 21:04:45 -- setup/common.sh@33 -- # echo 1024 00:03:51.103 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.103 21:04:45 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:51.103 21:04:45 -- setup/hugepages.sh@112 -- # get_nodes 00:03:51.103 21:04:45 -- setup/hugepages.sh@27 -- # local node 00:03:51.103 21:04:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.103 21:04:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:51.103 21:04:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.103 21:04:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:51.103 21:04:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:51.103 21:04:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:51.103 21:04:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:51.103 21:04:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:51.103 21:04:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:51.103 21:04:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:51.103 21:04:45 -- setup/common.sh@18 -- # local node=0 00:03:51.103 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.103 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.103 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.103 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:51.103 21:04:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:51.103 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.103 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 27336508 kB' 'MemUsed: 5292504 kB' 'SwapCached: 0 kB' 'Active: 2534128 kB' 'Inactive: 173828 kB' 'Active(anon): 1916072 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349032 kB' 'Mapped: 37488 kB' 'AnonPages: 362136 kB' 'Shmem: 1557148 kB' 'KernelStack: 12216 kB' 'PageTables: 4880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123520 kB' 'Slab: 445236 kB' 'SReclaimable: 123520 kB' 'SUnreclaim: 321716 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.103 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.103 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@33 -- # echo 0 00:03:51.104 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.104 21:04:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:51.104 21:04:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:51.104 21:04:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:51.104 21:04:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:51.104 21:04:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:51.104 21:04:45 -- setup/common.sh@18 -- # local node=1 00:03:51.104 21:04:45 -- setup/common.sh@19 -- # local var val 00:03:51.104 21:04:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.104 21:04:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.104 21:04:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:51.104 21:04:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:51.104 21:04:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.104 21:04:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60686184 kB' 'MemFree: 50179000 kB' 'MemUsed: 10507184 kB' 'SwapCached: 0 kB' 'Active: 5330396 kB' 'Inactive: 3262328 kB' 'Active(anon): 4795096 kB' 'Inactive(anon): 0 kB' 'Active(file): 535300 kB' 'Inactive(file): 3262328 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8327636 kB' 'Mapped: 170728 kB' 'AnonPages: 265200 kB' 'Shmem: 4530008 kB' 'KernelStack: 10632 kB' 'PageTables: 4276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 140140 kB' 'Slab: 384748 kB' 'SReclaimable: 140140 kB' 'SUnreclaim: 244608 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.104 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.104 21:04:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # continue 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.105 21:04:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.105 21:04:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:51.105 21:04:45 -- setup/common.sh@33 -- # echo 0 00:03:51.105 21:04:45 -- setup/common.sh@33 -- # return 0 00:03:51.105 21:04:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:51.105 21:04:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:51.105 21:04:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:51.105 21:04:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:51.105 21:04:45 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:51.105 node0=512 expecting 512 00:03:51.105 21:04:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:51.105 21:04:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:51.105 21:04:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:51.105 21:04:45 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:51.105 node1=512 expecting 512 00:03:51.105 21:04:45 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:51.105 00:03:51.105 real 0m4.128s 00:03:51.105 user 0m1.600s 00:03:51.105 sys 0m2.568s 00:03:51.105 21:04:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:51.105 21:04:45 -- common/autotest_common.sh@10 -- # set +x 00:03:51.105 ************************************ 00:03:51.105 END TEST per_node_1G_alloc 00:03:51.105 ************************************ 00:03:51.105 21:04:45 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:51.105 21:04:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:51.105 21:04:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:51.105 21:04:45 -- common/autotest_common.sh@10 -- # set +x 00:03:51.364 ************************************ 00:03:51.364 START TEST even_2G_alloc 00:03:51.364 ************************************ 00:03:51.364 21:04:45 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:03:51.364 21:04:45 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:51.364 21:04:45 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:51.364 21:04:45 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:51.364 21:04:45 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:51.364 21:04:45 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:51.364 21:04:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:51.364 21:04:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:51.364 21:04:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:51.364 21:04:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:51.364 21:04:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:51.364 21:04:45 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:51.364 21:04:45 -- setup/hugepages.sh@83 -- # : 512 00:03:51.364 21:04:45 -- setup/hugepages.sh@84 -- # : 1 00:03:51.364 21:04:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:51.364 21:04:45 -- setup/hugepages.sh@83 -- # : 0 00:03:51.364 21:04:45 -- setup/hugepages.sh@84 -- # : 0 00:03:51.364 21:04:45 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:51.364 21:04:45 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:51.364 21:04:45 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:51.364 21:04:45 -- setup/hugepages.sh@153 -- # setup output 00:03:51.364 21:04:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.364 21:04:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:53.894 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:53.894 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:53.894 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:53.894 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:53.895 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:54.830 21:04:49 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:54.830 21:04:49 -- setup/hugepages.sh@89 -- # local node 00:03:54.830 21:04:49 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:54.830 21:04:49 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:54.830 21:04:49 -- setup/hugepages.sh@92 -- # local surp 00:03:54.830 21:04:49 -- setup/hugepages.sh@93 -- # local resv 00:03:54.830 21:04:49 -- setup/hugepages.sh@94 -- # local anon 00:03:54.830 21:04:49 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:54.830 21:04:49 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:54.830 21:04:49 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:54.830 21:04:49 -- setup/common.sh@18 -- # local node= 00:03:54.830 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:54.830 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:54.830 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:54.830 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:54.830 21:04:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:54.830 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:54.830 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:54.830 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.830 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77518640 kB' 'MemAvailable: 81643724 kB' 'Buffers: 4988 kB' 'Cached: 10671768 kB' 'SwapCached: 0 kB' 'Active: 7866476 kB' 'Inactive: 3436156 kB' 'Active(anon): 6713120 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629244 kB' 'Mapped: 208288 kB' 'Shmem: 6087244 kB' 'KReclaimable: 263532 kB' 'Slab: 830240 kB' 'SReclaimable: 263532 kB' 'SUnreclaim: 566708 kB' 'KernelStack: 22880 kB' 'PageTables: 9264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218448 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.831 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.831 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:54.831 21:04:49 -- setup/common.sh@33 -- # echo 0 00:03:54.831 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:54.831 21:04:49 -- setup/hugepages.sh@97 -- # anon=0 00:03:54.832 21:04:49 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:54.832 21:04:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:54.832 21:04:49 -- setup/common.sh@18 -- # local node= 00:03:54.832 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:54.832 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:54.832 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:54.832 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:54.832 21:04:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:54.832 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:54.832 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77519428 kB' 'MemAvailable: 81644512 kB' 'Buffers: 4988 kB' 'Cached: 10671772 kB' 'SwapCached: 0 kB' 'Active: 7866048 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712692 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628844 kB' 'Mapped: 208264 kB' 'Shmem: 6087248 kB' 'KReclaimable: 263532 kB' 'Slab: 830232 kB' 'SReclaimable: 263532 kB' 'SUnreclaim: 566700 kB' 'KernelStack: 22864 kB' 'PageTables: 9208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218416 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.832 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.832 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # continue 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:54.833 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:54.833 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.095 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.096 21:04:49 -- setup/common.sh@33 -- # echo 0 00:03:55.096 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:55.096 21:04:49 -- setup/hugepages.sh@99 -- # surp=0 00:03:55.096 21:04:49 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:55.096 21:04:49 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:55.096 21:04:49 -- setup/common.sh@18 -- # local node= 00:03:55.096 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:55.096 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.096 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.096 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.096 21:04:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.096 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.096 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77521332 kB' 'MemAvailable: 81646416 kB' 'Buffers: 4988 kB' 'Cached: 10671784 kB' 'SwapCached: 0 kB' 'Active: 7866080 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712724 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628848 kB' 'Mapped: 208264 kB' 'Shmem: 6087260 kB' 'KReclaimable: 263532 kB' 'Slab: 830216 kB' 'SReclaimable: 263532 kB' 'SUnreclaim: 566684 kB' 'KernelStack: 22864 kB' 'PageTables: 9208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218416 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.096 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.096 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.097 21:04:49 -- setup/common.sh@33 -- # echo 0 00:03:55.097 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:55.097 21:04:49 -- setup/hugepages.sh@100 -- # resv=0 00:03:55.097 21:04:49 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:55.097 nr_hugepages=1024 00:03:55.097 21:04:49 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:55.097 resv_hugepages=0 00:03:55.097 21:04:49 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:55.097 surplus_hugepages=0 00:03:55.097 21:04:49 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:55.097 anon_hugepages=0 00:03:55.097 21:04:49 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.097 21:04:49 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:55.097 21:04:49 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:55.097 21:04:49 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:55.097 21:04:49 -- setup/common.sh@18 -- # local node= 00:03:55.097 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:55.097 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.097 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.097 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.097 21:04:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.097 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.097 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.097 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77521504 kB' 'MemAvailable: 81646588 kB' 'Buffers: 4988 kB' 'Cached: 10671808 kB' 'SwapCached: 0 kB' 'Active: 7865732 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712376 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628444 kB' 'Mapped: 208264 kB' 'Shmem: 6087284 kB' 'KReclaimable: 263532 kB' 'Slab: 830216 kB' 'SReclaimable: 263532 kB' 'SUnreclaim: 566684 kB' 'KernelStack: 22848 kB' 'PageTables: 9156 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8155532 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218416 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.097 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.097 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.098 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.098 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.099 21:04:49 -- setup/common.sh@33 -- # echo 1024 00:03:55.099 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:55.099 21:04:49 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.099 21:04:49 -- setup/hugepages.sh@112 -- # get_nodes 00:03:55.099 21:04:49 -- setup/hugepages.sh@27 -- # local node 00:03:55.099 21:04:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.099 21:04:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.099 21:04:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.099 21:04:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.099 21:04:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:55.099 21:04:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:55.099 21:04:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.099 21:04:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.099 21:04:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:55.099 21:04:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.099 21:04:49 -- setup/common.sh@18 -- # local node=0 00:03:55.099 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:55.099 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.099 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.099 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:55.099 21:04:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:55.099 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.099 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 27333596 kB' 'MemUsed: 5295416 kB' 'SwapCached: 0 kB' 'Active: 2533488 kB' 'Inactive: 173828 kB' 'Active(anon): 1915432 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349112 kB' 'Mapped: 37488 kB' 'AnonPages: 361360 kB' 'Shmem: 1557228 kB' 'KernelStack: 12200 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123392 kB' 'Slab: 444944 kB' 'SReclaimable: 123392 kB' 'SUnreclaim: 321552 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.099 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.099 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@33 -- # echo 0 00:03:55.100 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:55.100 21:04:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.100 21:04:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.100 21:04:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.100 21:04:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:55.100 21:04:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.100 21:04:49 -- setup/common.sh@18 -- # local node=1 00:03:55.100 21:04:49 -- setup/common.sh@19 -- # local var val 00:03:55.100 21:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.100 21:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.100 21:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:55.100 21:04:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:55.100 21:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.100 21:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60686184 kB' 'MemFree: 50187908 kB' 'MemUsed: 10498276 kB' 'SwapCached: 0 kB' 'Active: 5332532 kB' 'Inactive: 3262328 kB' 'Active(anon): 4797232 kB' 'Inactive(anon): 0 kB' 'Active(file): 535300 kB' 'Inactive(file): 3262328 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8327684 kB' 'Mapped: 170776 kB' 'AnonPages: 267376 kB' 'Shmem: 4530056 kB' 'KernelStack: 10648 kB' 'PageTables: 4376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 140140 kB' 'Slab: 385272 kB' 'SReclaimable: 140140 kB' 'SUnreclaim: 245132 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.100 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.100 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # continue 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.101 21:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.101 21:04:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.101 21:04:49 -- setup/common.sh@33 -- # echo 0 00:03:55.101 21:04:49 -- setup/common.sh@33 -- # return 0 00:03:55.101 21:04:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.101 21:04:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.101 21:04:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.101 21:04:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.101 21:04:49 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:55.101 node0=512 expecting 512 00:03:55.101 21:04:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.101 21:04:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.101 21:04:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.101 21:04:49 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:55.101 node1=512 expecting 512 00:03:55.101 21:04:49 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:55.101 00:03:55.101 real 0m3.808s 00:03:55.101 user 0m1.398s 00:03:55.101 sys 0m2.266s 00:03:55.101 21:04:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:55.101 21:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.101 ************************************ 00:03:55.101 END TEST even_2G_alloc 00:03:55.101 ************************************ 00:03:55.101 21:04:49 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:55.101 21:04:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:55.101 21:04:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:55.101 21:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.360 ************************************ 00:03:55.360 START TEST odd_alloc 00:03:55.360 ************************************ 00:03:55.360 21:04:49 -- common/autotest_common.sh@1111 -- # odd_alloc 00:03:55.360 21:04:49 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:55.360 21:04:49 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:55.360 21:04:49 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:55.360 21:04:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:55.360 21:04:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:55.360 21:04:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:55.360 21:04:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:55.360 21:04:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:55.360 21:04:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:55.360 21:04:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:55.360 21:04:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:55.360 21:04:49 -- setup/hugepages.sh@83 -- # : 513 00:03:55.360 21:04:49 -- setup/hugepages.sh@84 -- # : 1 00:03:55.360 21:04:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:55.360 21:04:49 -- setup/hugepages.sh@83 -- # : 0 00:03:55.360 21:04:49 -- setup/hugepages.sh@84 -- # : 0 00:03:55.360 21:04:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:55.360 21:04:49 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:55.360 21:04:49 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:55.360 21:04:49 -- setup/hugepages.sh@160 -- # setup output 00:03:55.360 21:04:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:55.360 21:04:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:57.892 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:57.892 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:58.831 21:04:53 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:58.831 21:04:53 -- setup/hugepages.sh@89 -- # local node 00:03:58.831 21:04:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:58.831 21:04:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:58.831 21:04:53 -- setup/hugepages.sh@92 -- # local surp 00:03:58.831 21:04:53 -- setup/hugepages.sh@93 -- # local resv 00:03:58.831 21:04:53 -- setup/hugepages.sh@94 -- # local anon 00:03:58.831 21:04:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:58.831 21:04:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:58.831 21:04:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:58.831 21:04:53 -- setup/common.sh@18 -- # local node= 00:03:58.831 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:58.831 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.831 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.831 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.831 21:04:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.831 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.831 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.831 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.831 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.831 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77555312 kB' 'MemAvailable: 81680396 kB' 'Buffers: 4988 kB' 'Cached: 10671924 kB' 'SwapCached: 0 kB' 'Active: 7867204 kB' 'Inactive: 3436156 kB' 'Active(anon): 6713848 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629304 kB' 'Mapped: 208412 kB' 'Shmem: 6087400 kB' 'KReclaimable: 263532 kB' 'Slab: 830264 kB' 'SReclaimable: 263532 kB' 'SUnreclaim: 566732 kB' 'KernelStack: 22896 kB' 'PageTables: 9364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996600 kB' 'Committed_AS: 8156588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:58.831 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.831 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.831 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.831 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.831 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.831 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.831 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.832 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.832 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:58.833 21:04:53 -- setup/common.sh@33 -- # echo 0 00:03:58.833 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:58.833 21:04:53 -- setup/hugepages.sh@97 -- # anon=0 00:03:58.833 21:04:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:58.833 21:04:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:58.833 21:04:53 -- setup/common.sh@18 -- # local node= 00:03:58.833 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:58.833 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.833 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.833 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.833 21:04:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.833 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.833 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77556000 kB' 'MemAvailable: 81681036 kB' 'Buffers: 4988 kB' 'Cached: 10671928 kB' 'SwapCached: 0 kB' 'Active: 7866252 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712896 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628812 kB' 'Mapped: 208332 kB' 'Shmem: 6087404 kB' 'KReclaimable: 263436 kB' 'Slab: 830152 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 566716 kB' 'KernelStack: 22864 kB' 'PageTables: 9212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996600 kB' 'Committed_AS: 8156600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.833 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.833 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:58.834 21:04:53 -- setup/common.sh@33 -- # echo 0 00:03:58.834 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:58.834 21:04:53 -- setup/hugepages.sh@99 -- # surp=0 00:03:58.834 21:04:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:58.834 21:04:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:58.834 21:04:53 -- setup/common.sh@18 -- # local node= 00:03:58.834 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:58.834 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:58.834 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:58.834 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:58.834 21:04:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:58.834 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:58.834 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77556576 kB' 'MemAvailable: 81681612 kB' 'Buffers: 4988 kB' 'Cached: 10671940 kB' 'SwapCached: 0 kB' 'Active: 7866272 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712916 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628804 kB' 'Mapped: 208332 kB' 'Shmem: 6087416 kB' 'KReclaimable: 263436 kB' 'Slab: 830152 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 566716 kB' 'KernelStack: 22864 kB' 'PageTables: 9212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996600 kB' 'Committed_AS: 8156616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.834 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.834 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.835 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.835 21:04:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # continue 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:58.836 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:58.836 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:58.836 21:04:53 -- setup/common.sh@33 -- # echo 0 00:03:58.836 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:59.148 21:04:53 -- setup/hugepages.sh@100 -- # resv=0 00:03:59.148 21:04:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:59.148 nr_hugepages=1025 00:03:59.148 21:04:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:59.148 resv_hugepages=0 00:03:59.148 21:04:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:59.148 surplus_hugepages=0 00:03:59.148 21:04:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:59.148 anon_hugepages=0 00:03:59.148 21:04:53 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:59.148 21:04:53 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:59.148 21:04:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:59.148 21:04:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:59.148 21:04:53 -- setup/common.sh@18 -- # local node= 00:03:59.148 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:59.148 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.148 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.148 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.148 21:04:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.148 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.148 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77558596 kB' 'MemAvailable: 81683632 kB' 'Buffers: 4988 kB' 'Cached: 10671956 kB' 'SwapCached: 0 kB' 'Active: 7866284 kB' 'Inactive: 3436156 kB' 'Active(anon): 6712928 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 628808 kB' 'Mapped: 208332 kB' 'Shmem: 6087432 kB' 'KReclaimable: 263436 kB' 'Slab: 830152 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 566716 kB' 'KernelStack: 22864 kB' 'PageTables: 9212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996600 kB' 'Committed_AS: 8156632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.148 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.148 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.149 21:04:53 -- setup/common.sh@33 -- # echo 1025 00:03:59.149 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:59.149 21:04:53 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:59.149 21:04:53 -- setup/hugepages.sh@112 -- # get_nodes 00:03:59.149 21:04:53 -- setup/hugepages.sh@27 -- # local node 00:03:59.149 21:04:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.149 21:04:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:59.149 21:04:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.149 21:04:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:59.149 21:04:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:59.149 21:04:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:59.149 21:04:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:59.149 21:04:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:59.149 21:04:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:59.149 21:04:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.149 21:04:53 -- setup/common.sh@18 -- # local node=0 00:03:59.149 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:59.149 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.149 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.149 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:59.149 21:04:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:59.149 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.149 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 27345932 kB' 'MemUsed: 5283080 kB' 'SwapCached: 0 kB' 'Active: 2532636 kB' 'Inactive: 173828 kB' 'Active(anon): 1914580 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349208 kB' 'Mapped: 37488 kB' 'AnonPages: 360396 kB' 'Shmem: 1557324 kB' 'KernelStack: 12200 kB' 'PageTables: 4832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123296 kB' 'Slab: 444592 kB' 'SReclaimable: 123296 kB' 'SUnreclaim: 321296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.149 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.149 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@33 -- # echo 0 00:03:59.150 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:59.150 21:04:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:59.150 21:04:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:59.150 21:04:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:59.150 21:04:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:59.150 21:04:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.150 21:04:53 -- setup/common.sh@18 -- # local node=1 00:03:59.150 21:04:53 -- setup/common.sh@19 -- # local var val 00:03:59.150 21:04:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.150 21:04:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.150 21:04:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:59.150 21:04:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:59.150 21:04:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.150 21:04:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60686184 kB' 'MemFree: 50212232 kB' 'MemUsed: 10473952 kB' 'SwapCached: 0 kB' 'Active: 5333728 kB' 'Inactive: 3262328 kB' 'Active(anon): 4798428 kB' 'Inactive(anon): 0 kB' 'Active(file): 535300 kB' 'Inactive(file): 3262328 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8327764 kB' 'Mapped: 170844 kB' 'AnonPages: 268480 kB' 'Shmem: 4530136 kB' 'KernelStack: 10680 kB' 'PageTables: 4472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 140140 kB' 'Slab: 385560 kB' 'SReclaimable: 140140 kB' 'SUnreclaim: 245420 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.150 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.150 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # continue 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.151 21:04:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.151 21:04:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.151 21:04:53 -- setup/common.sh@33 -- # echo 0 00:03:59.151 21:04:53 -- setup/common.sh@33 -- # return 0 00:03:59.151 21:04:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:59.151 21:04:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:59.151 21:04:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:59.151 21:04:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:59.151 21:04:53 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:59.151 node0=512 expecting 513 00:03:59.151 21:04:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:59.151 21:04:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:59.151 21:04:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:59.151 21:04:53 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:59.151 node1=513 expecting 512 00:03:59.151 21:04:53 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:59.151 00:03:59.151 real 0m3.820s 00:03:59.151 user 0m1.328s 00:03:59.151 sys 0m2.473s 00:03:59.151 21:04:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:59.151 21:04:53 -- common/autotest_common.sh@10 -- # set +x 00:03:59.151 ************************************ 00:03:59.151 END TEST odd_alloc 00:03:59.151 ************************************ 00:03:59.151 21:04:53 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:59.151 21:04:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.151 21:04:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.151 21:04:53 -- common/autotest_common.sh@10 -- # set +x 00:03:59.151 ************************************ 00:03:59.151 START TEST custom_alloc 00:03:59.151 ************************************ 00:03:59.151 21:04:53 -- common/autotest_common.sh@1111 -- # custom_alloc 00:03:59.151 21:04:53 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:59.151 21:04:53 -- setup/hugepages.sh@169 -- # local node 00:03:59.151 21:04:53 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:59.151 21:04:53 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:59.151 21:04:53 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:59.151 21:04:53 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:59.151 21:04:53 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:59.151 21:04:53 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:59.151 21:04:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:59.151 21:04:53 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:59.152 21:04:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.152 21:04:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:59.152 21:04:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.152 21:04:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:59.152 21:04:53 -- setup/hugepages.sh@83 -- # : 256 00:03:59.152 21:04:53 -- setup/hugepages.sh@84 -- # : 1 00:03:59.152 21:04:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:59.152 21:04:53 -- setup/hugepages.sh@83 -- # : 0 00:03:59.152 21:04:53 -- setup/hugepages.sh@84 -- # : 0 00:03:59.152 21:04:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:59.152 21:04:53 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:59.152 21:04:53 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:59.152 21:04:53 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:59.152 21:04:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.152 21:04:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:59.152 21:04:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.152 21:04:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:59.152 21:04:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:59.152 21:04:53 -- setup/hugepages.sh@78 -- # return 0 00:03:59.152 21:04:53 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:59.152 21:04:53 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:59.152 21:04:53 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:59.152 21:04:53 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:59.152 21:04:53 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:59.152 21:04:53 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.152 21:04:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:59.152 21:04:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.152 21:04:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.152 21:04:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:59.152 21:04:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:59.152 21:04:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:59.152 21:04:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:59.152 21:04:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:59.152 21:04:53 -- setup/hugepages.sh@78 -- # return 0 00:03:59.152 21:04:53 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:59.152 21:04:53 -- setup/hugepages.sh@187 -- # setup output 00:03:59.152 21:04:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.152 21:04:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:02.444 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:02.444 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:03.384 21:04:57 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:03.384 21:04:57 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:03.384 21:04:57 -- setup/hugepages.sh@89 -- # local node 00:04:03.384 21:04:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:03.384 21:04:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:03.384 21:04:57 -- setup/hugepages.sh@92 -- # local surp 00:04:03.384 21:04:57 -- setup/hugepages.sh@93 -- # local resv 00:04:03.384 21:04:57 -- setup/hugepages.sh@94 -- # local anon 00:04:03.384 21:04:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:03.384 21:04:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:03.384 21:04:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:03.384 21:04:57 -- setup/common.sh@18 -- # local node= 00:04:03.384 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.384 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.384 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.384 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.384 21:04:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.384 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.384 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 76490468 kB' 'MemAvailable: 80615504 kB' 'Buffers: 4988 kB' 'Cached: 10672072 kB' 'SwapCached: 0 kB' 'Active: 7867684 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714328 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630048 kB' 'Mapped: 208476 kB' 'Shmem: 6087548 kB' 'KReclaimable: 263436 kB' 'Slab: 831496 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 22848 kB' 'PageTables: 9172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473336 kB' 'Committed_AS: 8157252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218496 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.384 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.384 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.385 21:04:57 -- setup/common.sh@33 -- # echo 0 00:04:03.385 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.385 21:04:57 -- setup/hugepages.sh@97 -- # anon=0 00:04:03.385 21:04:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:03.385 21:04:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.385 21:04:57 -- setup/common.sh@18 -- # local node= 00:04:03.385 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.385 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.385 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.385 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.385 21:04:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.385 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.385 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 76491136 kB' 'MemAvailable: 80616172 kB' 'Buffers: 4988 kB' 'Cached: 10672076 kB' 'SwapCached: 0 kB' 'Active: 7867356 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714000 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629768 kB' 'Mapped: 208476 kB' 'Shmem: 6087552 kB' 'KReclaimable: 263436 kB' 'Slab: 831496 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 568060 kB' 'KernelStack: 22848 kB' 'PageTables: 9172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473336 kB' 'Committed_AS: 8157264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.385 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.385 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.386 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.386 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.387 21:04:57 -- setup/common.sh@33 -- # echo 0 00:04:03.387 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.387 21:04:57 -- setup/hugepages.sh@99 -- # surp=0 00:04:03.387 21:04:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:03.387 21:04:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:03.387 21:04:57 -- setup/common.sh@18 -- # local node= 00:04:03.387 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.387 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.387 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.387 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.387 21:04:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.387 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.387 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 76491136 kB' 'MemAvailable: 80616172 kB' 'Buffers: 4988 kB' 'Cached: 10672076 kB' 'SwapCached: 0 kB' 'Active: 7867088 kB' 'Inactive: 3436156 kB' 'Active(anon): 6713732 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629408 kB' 'Mapped: 208400 kB' 'Shmem: 6087552 kB' 'KReclaimable: 263436 kB' 'Slab: 831492 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 568056 kB' 'KernelStack: 22896 kB' 'PageTables: 9300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473336 kB' 'Committed_AS: 8157280 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.387 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.387 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.388 21:04:57 -- setup/common.sh@33 -- # echo 0 00:04:03.388 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.388 21:04:57 -- setup/hugepages.sh@100 -- # resv=0 00:04:03.388 21:04:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:03.388 nr_hugepages=1536 00:04:03.388 21:04:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:03.388 resv_hugepages=0 00:04:03.388 21:04:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:03.388 surplus_hugepages=0 00:04:03.388 21:04:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:03.388 anon_hugepages=0 00:04:03.388 21:04:57 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:03.388 21:04:57 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:03.388 21:04:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:03.388 21:04:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:03.388 21:04:57 -- setup/common.sh@18 -- # local node= 00:04:03.388 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.388 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.388 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.388 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.388 21:04:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.388 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.388 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 76491560 kB' 'MemAvailable: 80616596 kB' 'Buffers: 4988 kB' 'Cached: 10672100 kB' 'SwapCached: 0 kB' 'Active: 7867388 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714032 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 629748 kB' 'Mapped: 208400 kB' 'Shmem: 6087576 kB' 'KReclaimable: 263436 kB' 'Slab: 831492 kB' 'SReclaimable: 263436 kB' 'SUnreclaim: 568056 kB' 'KernelStack: 22928 kB' 'PageTables: 9400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473336 kB' 'Committed_AS: 8160536 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218464 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.388 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.388 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.389 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.389 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.390 21:04:57 -- setup/common.sh@33 -- # echo 1536 00:04:03.390 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.390 21:04:57 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:03.390 21:04:57 -- setup/hugepages.sh@112 -- # get_nodes 00:04:03.390 21:04:57 -- setup/hugepages.sh@27 -- # local node 00:04:03.390 21:04:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.390 21:04:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:03.390 21:04:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.390 21:04:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:03.390 21:04:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:03.390 21:04:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:03.390 21:04:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.390 21:04:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.390 21:04:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:03.390 21:04:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.390 21:04:57 -- setup/common.sh@18 -- # local node=0 00:04:03.390 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.390 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.390 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.390 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:03.390 21:04:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:03.390 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.390 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 27346324 kB' 'MemUsed: 5282688 kB' 'SwapCached: 0 kB' 'Active: 2532392 kB' 'Inactive: 173828 kB' 'Active(anon): 1914336 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349220 kB' 'Mapped: 37488 kB' 'AnonPages: 360096 kB' 'Shmem: 1557336 kB' 'KernelStack: 12200 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123296 kB' 'Slab: 444520 kB' 'SReclaimable: 123296 kB' 'SUnreclaim: 321224 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.390 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.390 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@33 -- # echo 0 00:04:03.391 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.391 21:04:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.391 21:04:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.391 21:04:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.391 21:04:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:03.391 21:04:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.391 21:04:57 -- setup/common.sh@18 -- # local node=1 00:04:03.391 21:04:57 -- setup/common.sh@19 -- # local var val 00:04:03.391 21:04:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.391 21:04:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.391 21:04:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:03.391 21:04:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:03.391 21:04:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.391 21:04:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60686184 kB' 'MemFree: 49145356 kB' 'MemUsed: 11540828 kB' 'SwapCached: 0 kB' 'Active: 5334296 kB' 'Inactive: 3262328 kB' 'Active(anon): 4798996 kB' 'Inactive(anon): 0 kB' 'Active(file): 535300 kB' 'Inactive(file): 3262328 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8327900 kB' 'Mapped: 170912 kB' 'AnonPages: 268876 kB' 'Shmem: 4530272 kB' 'KernelStack: 10632 kB' 'PageTables: 4276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 140140 kB' 'Slab: 386972 kB' 'SReclaimable: 140140 kB' 'SUnreclaim: 246832 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.391 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.391 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # continue 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.392 21:04:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.392 21:04:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.392 21:04:57 -- setup/common.sh@33 -- # echo 0 00:04:03.392 21:04:57 -- setup/common.sh@33 -- # return 0 00:04:03.392 21:04:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.392 21:04:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.392 21:04:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.392 21:04:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.392 21:04:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:03.392 node0=512 expecting 512 00:04:03.392 21:04:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.392 21:04:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.392 21:04:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.392 21:04:57 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:03.392 node1=1024 expecting 1024 00:04:03.392 21:04:57 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:03.392 00:04:03.392 real 0m4.112s 00:04:03.392 user 0m1.600s 00:04:03.392 sys 0m2.546s 00:04:03.392 21:04:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:03.392 21:04:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.392 ************************************ 00:04:03.392 END TEST custom_alloc 00:04:03.392 ************************************ 00:04:03.392 21:04:57 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:03.392 21:04:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.392 21:04:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.392 21:04:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.392 ************************************ 00:04:03.392 START TEST no_shrink_alloc 00:04:03.392 ************************************ 00:04:03.392 21:04:57 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:04:03.392 21:04:57 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:03.392 21:04:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:03.392 21:04:57 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:03.392 21:04:57 -- setup/hugepages.sh@51 -- # shift 00:04:03.392 21:04:57 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:03.392 21:04:57 -- setup/hugepages.sh@52 -- # local node_ids 00:04:03.392 21:04:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:03.392 21:04:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:03.392 21:04:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:03.392 21:04:57 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:03.392 21:04:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.392 21:04:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:03.392 21:04:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.392 21:04:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.392 21:04:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.392 21:04:57 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:03.392 21:04:57 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:03.392 21:04:57 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:03.392 21:04:57 -- setup/hugepages.sh@73 -- # return 0 00:04:03.392 21:04:57 -- setup/hugepages.sh@198 -- # setup output 00:04:03.392 21:04:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.392 21:04:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:05.927 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:05.927 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:07.308 21:05:01 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:07.308 21:05:01 -- setup/hugepages.sh@89 -- # local node 00:04:07.308 21:05:01 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:07.308 21:05:01 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:07.308 21:05:01 -- setup/hugepages.sh@92 -- # local surp 00:04:07.308 21:05:01 -- setup/hugepages.sh@93 -- # local resv 00:04:07.308 21:05:01 -- setup/hugepages.sh@94 -- # local anon 00:04:07.308 21:05:01 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:07.308 21:05:01 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:07.308 21:05:01 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:07.308 21:05:01 -- setup/common.sh@18 -- # local node= 00:04:07.308 21:05:01 -- setup/common.sh@19 -- # local var val 00:04:07.308 21:05:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:07.308 21:05:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:07.308 21:05:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:07.308 21:05:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:07.308 21:05:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:07.308 21:05:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77531076 kB' 'MemAvailable: 81656064 kB' 'Buffers: 4988 kB' 'Cached: 10672224 kB' 'SwapCached: 0 kB' 'Active: 7869196 kB' 'Inactive: 3436156 kB' 'Active(anon): 6715840 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630960 kB' 'Mapped: 208544 kB' 'Shmem: 6087700 kB' 'KReclaimable: 263340 kB' 'Slab: 830432 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567092 kB' 'KernelStack: 22800 kB' 'PageTables: 9360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8161208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218448 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.308 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.308 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.309 21:05:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:07.309 21:05:01 -- setup/common.sh@33 -- # echo 0 00:04:07.309 21:05:01 -- setup/common.sh@33 -- # return 0 00:04:07.309 21:05:01 -- setup/hugepages.sh@97 -- # anon=0 00:04:07.309 21:05:01 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:07.309 21:05:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:07.309 21:05:01 -- setup/common.sh@18 -- # local node= 00:04:07.309 21:05:01 -- setup/common.sh@19 -- # local var val 00:04:07.309 21:05:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:07.309 21:05:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:07.309 21:05:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:07.309 21:05:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:07.309 21:05:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:07.309 21:05:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.309 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77530228 kB' 'MemAvailable: 81655216 kB' 'Buffers: 4988 kB' 'Cached: 10672228 kB' 'SwapCached: 0 kB' 'Active: 7868176 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714820 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630608 kB' 'Mapped: 208464 kB' 'Shmem: 6087704 kB' 'KReclaimable: 263340 kB' 'Slab: 830380 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567040 kB' 'KernelStack: 23040 kB' 'PageTables: 9696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8161216 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218352 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.310 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.310 21:05:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.311 21:05:01 -- setup/common.sh@33 -- # echo 0 00:04:07.311 21:05:01 -- setup/common.sh@33 -- # return 0 00:04:07.311 21:05:01 -- setup/hugepages.sh@99 -- # surp=0 00:04:07.311 21:05:01 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:07.311 21:05:01 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:07.311 21:05:01 -- setup/common.sh@18 -- # local node= 00:04:07.311 21:05:01 -- setup/common.sh@19 -- # local var val 00:04:07.311 21:05:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:07.311 21:05:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:07.311 21:05:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:07.311 21:05:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:07.311 21:05:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:07.311 21:05:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77528216 kB' 'MemAvailable: 81653204 kB' 'Buffers: 4988 kB' 'Cached: 10672240 kB' 'SwapCached: 0 kB' 'Active: 7868144 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714788 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630584 kB' 'Mapped: 208464 kB' 'Shmem: 6087716 kB' 'KReclaimable: 263340 kB' 'Slab: 830284 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 566944 kB' 'KernelStack: 22976 kB' 'PageTables: 9360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8161232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218400 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.311 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.311 21:05:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.312 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:07.312 21:05:01 -- setup/common.sh@33 -- # echo 0 00:04:07.312 21:05:01 -- setup/common.sh@33 -- # return 0 00:04:07.312 21:05:01 -- setup/hugepages.sh@100 -- # resv=0 00:04:07.312 21:05:01 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:07.312 nr_hugepages=1024 00:04:07.312 21:05:01 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:07.312 resv_hugepages=0 00:04:07.312 21:05:01 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:07.312 surplus_hugepages=0 00:04:07.312 21:05:01 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:07.312 anon_hugepages=0 00:04:07.312 21:05:01 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:07.312 21:05:01 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:07.312 21:05:01 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:07.312 21:05:01 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:07.312 21:05:01 -- setup/common.sh@18 -- # local node= 00:04:07.312 21:05:01 -- setup/common.sh@19 -- # local var val 00:04:07.312 21:05:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:07.312 21:05:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:07.312 21:05:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:07.312 21:05:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:07.312 21:05:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:07.312 21:05:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.312 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77525488 kB' 'MemAvailable: 81650476 kB' 'Buffers: 4988 kB' 'Cached: 10672256 kB' 'SwapCached: 0 kB' 'Active: 7868340 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714984 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630636 kB' 'Mapped: 208464 kB' 'Shmem: 6087732 kB' 'KReclaimable: 263340 kB' 'Slab: 830284 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 566944 kB' 'KernelStack: 22992 kB' 'PageTables: 9264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8160900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218448 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.313 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.313 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:07.314 21:05:01 -- setup/common.sh@33 -- # echo 1024 00:04:07.314 21:05:01 -- setup/common.sh@33 -- # return 0 00:04:07.314 21:05:01 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:07.314 21:05:01 -- setup/hugepages.sh@112 -- # get_nodes 00:04:07.314 21:05:01 -- setup/hugepages.sh@27 -- # local node 00:04:07.314 21:05:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:07.314 21:05:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:07.314 21:05:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:07.314 21:05:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:07.314 21:05:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:07.314 21:05:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:07.314 21:05:01 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:07.314 21:05:01 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:07.314 21:05:01 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:07.314 21:05:01 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:07.314 21:05:01 -- setup/common.sh@18 -- # local node=0 00:04:07.314 21:05:01 -- setup/common.sh@19 -- # local var val 00:04:07.314 21:05:01 -- setup/common.sh@20 -- # local mem_f mem 00:04:07.314 21:05:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:07.314 21:05:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:07.314 21:05:01 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:07.314 21:05:01 -- setup/common.sh@28 -- # mapfile -t mem 00:04:07.314 21:05:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:07.314 21:05:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 26296468 kB' 'MemUsed: 6332544 kB' 'SwapCached: 0 kB' 'Active: 2533120 kB' 'Inactive: 173828 kB' 'Active(anon): 1915064 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349272 kB' 'Mapped: 37488 kB' 'AnonPages: 360892 kB' 'Shmem: 1557388 kB' 'KernelStack: 12248 kB' 'PageTables: 4928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123200 kB' 'Slab: 443840 kB' 'SReclaimable: 123200 kB' 'SUnreclaim: 320640 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.314 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.314 21:05:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # continue 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # IFS=': ' 00:04:07.315 21:05:01 -- setup/common.sh@31 -- # read -r var val _ 00:04:07.315 21:05:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:07.315 21:05:01 -- setup/common.sh@33 -- # echo 0 00:04:07.315 21:05:01 -- setup/common.sh@33 -- # return 0 00:04:07.315 21:05:01 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:07.315 21:05:01 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:07.315 21:05:01 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:07.315 21:05:01 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:07.315 21:05:01 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:07.315 node0=1024 expecting 1024 00:04:07.315 21:05:01 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:07.315 21:05:01 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:07.315 21:05:01 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:07.315 21:05:01 -- setup/hugepages.sh@202 -- # setup output 00:04:07.315 21:05:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:07.315 21:05:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:09.851 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:09.851 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:10.786 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:11.048 21:05:05 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:11.048 21:05:05 -- setup/hugepages.sh@89 -- # local node 00:04:11.048 21:05:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:11.048 21:05:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:11.048 21:05:05 -- setup/hugepages.sh@92 -- # local surp 00:04:11.048 21:05:05 -- setup/hugepages.sh@93 -- # local resv 00:04:11.048 21:05:05 -- setup/hugepages.sh@94 -- # local anon 00:04:11.048 21:05:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:11.048 21:05:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:11.048 21:05:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:11.048 21:05:05 -- setup/common.sh@18 -- # local node= 00:04:11.048 21:05:05 -- setup/common.sh@19 -- # local var val 00:04:11.049 21:05:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:11.049 21:05:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:11.049 21:05:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:11.049 21:05:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:11.049 21:05:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:11.049 21:05:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77527888 kB' 'MemAvailable: 81652876 kB' 'Buffers: 4988 kB' 'Cached: 10672344 kB' 'SwapCached: 0 kB' 'Active: 7868500 kB' 'Inactive: 3436156 kB' 'Active(anon): 6715144 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630736 kB' 'Mapped: 208508 kB' 'Shmem: 6087820 kB' 'KReclaimable: 263340 kB' 'Slab: 830480 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567140 kB' 'KernelStack: 22880 kB' 'PageTables: 9284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8158980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218480 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.049 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.049 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:11.050 21:05:05 -- setup/common.sh@33 -- # echo 0 00:04:11.050 21:05:05 -- setup/common.sh@33 -- # return 0 00:04:11.050 21:05:05 -- setup/hugepages.sh@97 -- # anon=0 00:04:11.050 21:05:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:11.050 21:05:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:11.050 21:05:05 -- setup/common.sh@18 -- # local node= 00:04:11.050 21:05:05 -- setup/common.sh@19 -- # local var val 00:04:11.050 21:05:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:11.050 21:05:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:11.050 21:05:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:11.050 21:05:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:11.050 21:05:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:11.050 21:05:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77528312 kB' 'MemAvailable: 81653300 kB' 'Buffers: 4988 kB' 'Cached: 10672348 kB' 'SwapCached: 0 kB' 'Active: 7868980 kB' 'Inactive: 3436156 kB' 'Active(anon): 6715624 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 631264 kB' 'Mapped: 208508 kB' 'Shmem: 6087824 kB' 'KReclaimable: 263340 kB' 'Slab: 830480 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567140 kB' 'KernelStack: 22864 kB' 'PageTables: 9228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8158988 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218432 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.050 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.050 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.051 21:05:05 -- setup/common.sh@33 -- # echo 0 00:04:11.051 21:05:05 -- setup/common.sh@33 -- # return 0 00:04:11.051 21:05:05 -- setup/hugepages.sh@99 -- # surp=0 00:04:11.051 21:05:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:11.051 21:05:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:11.051 21:05:05 -- setup/common.sh@18 -- # local node= 00:04:11.051 21:05:05 -- setup/common.sh@19 -- # local var val 00:04:11.051 21:05:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:11.051 21:05:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:11.051 21:05:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:11.051 21:05:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:11.051 21:05:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:11.051 21:05:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77527648 kB' 'MemAvailable: 81652636 kB' 'Buffers: 4988 kB' 'Cached: 10672360 kB' 'SwapCached: 0 kB' 'Active: 7868260 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714904 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630500 kB' 'Mapped: 208508 kB' 'Shmem: 6087836 kB' 'KReclaimable: 263340 kB' 'Slab: 830552 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567212 kB' 'KernelStack: 22864 kB' 'PageTables: 9224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8159004 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218432 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.051 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.051 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.052 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.052 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:11.053 21:05:05 -- setup/common.sh@33 -- # echo 0 00:04:11.053 21:05:05 -- setup/common.sh@33 -- # return 0 00:04:11.053 21:05:05 -- setup/hugepages.sh@100 -- # resv=0 00:04:11.053 21:05:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:11.053 nr_hugepages=1024 00:04:11.053 21:05:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:11.053 resv_hugepages=0 00:04:11.053 21:05:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:11.053 surplus_hugepages=0 00:04:11.053 21:05:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:11.053 anon_hugepages=0 00:04:11.053 21:05:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:11.053 21:05:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:11.053 21:05:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:11.053 21:05:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:11.053 21:05:05 -- setup/common.sh@18 -- # local node= 00:04:11.053 21:05:05 -- setup/common.sh@19 -- # local var val 00:04:11.053 21:05:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:11.053 21:05:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:11.053 21:05:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:11.053 21:05:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:11.053 21:05:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:11.053 21:05:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:11.053 21:05:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315196 kB' 'MemFree: 77526972 kB' 'MemAvailable: 81651960 kB' 'Buffers: 4988 kB' 'Cached: 10672376 kB' 'SwapCached: 0 kB' 'Active: 7868288 kB' 'Inactive: 3436156 kB' 'Active(anon): 6714932 kB' 'Inactive(anon): 0 kB' 'Active(file): 1153356 kB' 'Inactive(file): 3436156 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 630500 kB' 'Mapped: 208508 kB' 'Shmem: 6087852 kB' 'KReclaimable: 263340 kB' 'Slab: 830552 kB' 'SReclaimable: 263340 kB' 'SUnreclaim: 567212 kB' 'KernelStack: 22864 kB' 'PageTables: 9224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997624 kB' 'Committed_AS: 8159020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 218432 kB' 'VmallocChunk: 0 kB' 'Percpu: 77504 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2244068 kB' 'DirectMap2M: 17354752 kB' 'DirectMap1G: 82837504 kB' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.053 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.053 21:05:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:11.054 21:05:05 -- setup/common.sh@33 -- # echo 1024 00:04:11.054 21:05:05 -- setup/common.sh@33 -- # return 0 00:04:11.054 21:05:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:11.054 21:05:05 -- setup/hugepages.sh@112 -- # get_nodes 00:04:11.054 21:05:05 -- setup/hugepages.sh@27 -- # local node 00:04:11.054 21:05:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:11.054 21:05:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:11.054 21:05:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:11.054 21:05:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:11.054 21:05:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:11.054 21:05:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:11.054 21:05:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:11.054 21:05:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:11.054 21:05:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:11.054 21:05:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:11.054 21:05:05 -- setup/common.sh@18 -- # local node=0 00:04:11.054 21:05:05 -- setup/common.sh@19 -- # local var val 00:04:11.054 21:05:05 -- setup/common.sh@20 -- # local mem_f mem 00:04:11.054 21:05:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:11.054 21:05:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:11.054 21:05:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:11.054 21:05:05 -- setup/common.sh@28 -- # mapfile -t mem 00:04:11.054 21:05:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32629012 kB' 'MemFree: 26302136 kB' 'MemUsed: 6326876 kB' 'SwapCached: 0 kB' 'Active: 2532644 kB' 'Inactive: 173828 kB' 'Active(anon): 1914588 kB' 'Inactive(anon): 0 kB' 'Active(file): 618056 kB' 'Inactive(file): 173828 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2349364 kB' 'Mapped: 37488 kB' 'AnonPages: 360284 kB' 'Shmem: 1557480 kB' 'KernelStack: 12200 kB' 'PageTables: 4780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 123200 kB' 'Slab: 444140 kB' 'SReclaimable: 123200 kB' 'SUnreclaim: 320940 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.054 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.054 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # continue 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # IFS=': ' 00:04:11.055 21:05:05 -- setup/common.sh@31 -- # read -r var val _ 00:04:11.055 21:05:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:11.055 21:05:05 -- setup/common.sh@33 -- # echo 0 00:04:11.055 21:05:05 -- setup/common.sh@33 -- # return 0 00:04:11.055 21:05:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:11.055 21:05:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:11.055 21:05:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:11.055 21:05:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:11.055 21:05:05 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:11.055 node0=1024 expecting 1024 00:04:11.055 21:05:05 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:11.055 00:04:11.055 real 0m7.614s 00:04:11.055 user 0m2.829s 00:04:11.055 sys 0m4.749s 00:04:11.055 21:05:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:11.055 21:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:11.055 ************************************ 00:04:11.055 END TEST no_shrink_alloc 00:04:11.055 ************************************ 00:04:11.055 21:05:05 -- setup/hugepages.sh@217 -- # clear_hp 00:04:11.055 21:05:05 -- setup/hugepages.sh@37 -- # local node hp 00:04:11.055 21:05:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:11.055 21:05:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:11.055 21:05:05 -- setup/hugepages.sh@41 -- # echo 0 00:04:11.055 21:05:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:11.055 21:05:05 -- setup/hugepages.sh@41 -- # echo 0 00:04:11.055 21:05:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:11.055 21:05:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:11.055 21:05:05 -- setup/hugepages.sh@41 -- # echo 0 00:04:11.055 21:05:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:11.055 21:05:05 -- setup/hugepages.sh@41 -- # echo 0 00:04:11.055 21:05:05 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:11.055 21:05:05 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:11.055 00:04:11.055 real 0m32.103s 00:04:11.055 user 0m10.776s 00:04:11.055 sys 0m17.873s 00:04:11.055 21:05:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:11.055 21:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:11.055 ************************************ 00:04:11.055 END TEST hugepages 00:04:11.055 ************************************ 00:04:11.315 21:05:05 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:04:11.315 21:05:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.315 21:05:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.315 21:05:05 -- common/autotest_common.sh@10 -- # set +x 00:04:11.315 ************************************ 00:04:11.315 START TEST driver 00:04:11.315 ************************************ 00:04:11.315 21:05:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:04:11.315 * Looking for test storage... 00:04:11.315 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:11.315 21:05:05 -- setup/driver.sh@68 -- # setup reset 00:04:11.315 21:05:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:11.315 21:05:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:16.592 21:05:10 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:16.592 21:05:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.592 21:05:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.592 21:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:16.592 ************************************ 00:04:16.592 START TEST guess_driver 00:04:16.592 ************************************ 00:04:16.592 21:05:10 -- common/autotest_common.sh@1111 -- # guess_driver 00:04:16.592 21:05:10 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:16.592 21:05:10 -- setup/driver.sh@47 -- # local fail=0 00:04:16.592 21:05:10 -- setup/driver.sh@49 -- # pick_driver 00:04:16.592 21:05:10 -- setup/driver.sh@36 -- # vfio 00:04:16.592 21:05:10 -- setup/driver.sh@21 -- # local iommu_grups 00:04:16.592 21:05:10 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:16.592 21:05:10 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:16.592 21:05:10 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:16.592 21:05:10 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:16.592 21:05:10 -- setup/driver.sh@29 -- # (( 181 > 0 )) 00:04:16.592 21:05:10 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:16.592 21:05:10 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:16.592 21:05:10 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:16.592 21:05:10 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:16.592 21:05:10 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:16.592 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:16.592 21:05:10 -- setup/driver.sh@30 -- # return 0 00:04:16.592 21:05:10 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:16.592 21:05:10 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:16.592 21:05:10 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:16.592 21:05:10 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:16.592 Looking for driver=vfio-pci 00:04:16.592 21:05:10 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:16.592 21:05:10 -- setup/driver.sh@45 -- # setup output config 00:04:16.592 21:05:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:16.592 21:05:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.122 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.122 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.122 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.380 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.380 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.381 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.381 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.381 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.381 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.381 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.381 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.381 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.381 21:05:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:19.381 21:05:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:19.381 21:05:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.667 21:05:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.667 21:05:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.667 21:05:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:24.042 21:05:17 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:24.042 21:05:17 -- setup/driver.sh@65 -- # setup reset 00:04:24.042 21:05:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:24.042 21:05:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:29.391 00:04:29.391 real 0m12.278s 00:04:29.391 user 0m2.735s 00:04:29.391 sys 0m5.402s 00:04:29.391 21:05:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:29.391 21:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:29.391 ************************************ 00:04:29.391 END TEST guess_driver 00:04:29.391 ************************************ 00:04:29.391 00:04:29.391 real 0m17.646s 00:04:29.391 user 0m4.343s 00:04:29.391 sys 0m8.370s 00:04:29.391 21:05:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:29.391 21:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:29.391 ************************************ 00:04:29.391 END TEST driver 00:04:29.391 ************************************ 00:04:29.391 21:05:23 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:04:29.391 21:05:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.391 21:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.391 21:05:23 -- common/autotest_common.sh@10 -- # set +x 00:04:29.391 ************************************ 00:04:29.391 START TEST devices 00:04:29.391 ************************************ 00:04:29.391 21:05:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:04:29.391 * Looking for test storage... 00:04:29.391 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:29.391 21:05:23 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:29.391 21:05:23 -- setup/devices.sh@192 -- # setup reset 00:04:29.391 21:05:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:29.391 21:05:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:33.576 21:05:27 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:33.576 21:05:27 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:33.576 21:05:27 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:33.576 21:05:27 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:33.576 21:05:27 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:33.576 21:05:27 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:33.576 21:05:27 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:33.576 21:05:27 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:33.576 21:05:27 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:33.576 21:05:27 -- setup/devices.sh@196 -- # blocks=() 00:04:33.576 21:05:27 -- setup/devices.sh@196 -- # declare -a blocks 00:04:33.576 21:05:27 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:33.576 21:05:27 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:33.576 21:05:27 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:33.576 21:05:27 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:33.576 21:05:27 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:33.576 21:05:27 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:33.576 21:05:27 -- setup/devices.sh@202 -- # pci=0000:d8:00.0 00:04:33.576 21:05:27 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\d\8\:\0\0\.\0* ]] 00:04:33.576 21:05:27 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:33.576 21:05:27 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:04:33.576 21:05:27 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:33.576 No valid GPT data, bailing 00:04:33.576 21:05:27 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:33.576 21:05:27 -- scripts/common.sh@391 -- # pt= 00:04:33.576 21:05:27 -- scripts/common.sh@392 -- # return 1 00:04:33.576 21:05:27 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:33.576 21:05:27 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:33.576 21:05:27 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:33.576 21:05:27 -- setup/common.sh@80 -- # echo 4000787030016 00:04:33.576 21:05:27 -- setup/devices.sh@204 -- # (( 4000787030016 >= min_disk_size )) 00:04:33.576 21:05:27 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:33.576 21:05:27 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:d8:00.0 00:04:33.576 21:05:27 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:33.576 21:05:27 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:33.576 21:05:27 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:33.576 21:05:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.576 21:05:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.576 21:05:27 -- common/autotest_common.sh@10 -- # set +x 00:04:33.576 ************************************ 00:04:33.576 START TEST nvme_mount 00:04:33.576 ************************************ 00:04:33.576 21:05:27 -- common/autotest_common.sh@1111 -- # nvme_mount 00:04:33.576 21:05:27 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:33.576 21:05:27 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:33.576 21:05:27 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:33.576 21:05:27 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:33.576 21:05:27 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:33.576 21:05:27 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:33.576 21:05:27 -- setup/common.sh@40 -- # local part_no=1 00:04:33.576 21:05:27 -- setup/common.sh@41 -- # local size=1073741824 00:04:33.576 21:05:27 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:33.576 21:05:27 -- setup/common.sh@44 -- # parts=() 00:04:33.576 21:05:27 -- setup/common.sh@44 -- # local parts 00:04:33.576 21:05:27 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:33.576 21:05:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:33.576 21:05:27 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:33.576 21:05:27 -- setup/common.sh@46 -- # (( part++ )) 00:04:33.576 21:05:27 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:33.576 21:05:27 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:33.576 21:05:27 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:33.576 21:05:27 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:34.144 Creating new GPT entries in memory. 00:04:34.144 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:34.144 other utilities. 00:04:34.144 21:05:28 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:34.144 21:05:28 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:34.144 21:05:28 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:34.144 21:05:28 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:34.144 21:05:28 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:35.079 Creating new GPT entries in memory. 00:04:35.079 The operation has completed successfully. 00:04:35.079 21:05:29 -- setup/common.sh@57 -- # (( part++ )) 00:04:35.079 21:05:29 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:35.079 21:05:29 -- setup/common.sh@62 -- # wait 1133438 00:04:35.079 21:05:29 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:35.079 21:05:29 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:35.079 21:05:29 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:35.079 21:05:29 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:35.079 21:05:29 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:35.079 21:05:29 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:35.339 21:05:29 -- setup/devices.sh@105 -- # verify 0000:d8:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:35.339 21:05:29 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:35.339 21:05:29 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:35.339 21:05:29 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:35.339 21:05:29 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:35.339 21:05:29 -- setup/devices.sh@53 -- # local found=0 00:04:35.339 21:05:29 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:35.339 21:05:29 -- setup/devices.sh@56 -- # : 00:04:35.339 21:05:29 -- setup/devices.sh@59 -- # local pci status 00:04:35.339 21:05:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:35.339 21:05:29 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:35.339 21:05:29 -- setup/devices.sh@47 -- # setup output config 00:04:35.339 21:05:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:35.339 21:05:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.875 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:37.875 21:05:31 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:37.876 21:05:31 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:37.876 21:05:31 -- setup/devices.sh@63 -- # found=1 00:04:37.876 21:05:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.254 21:05:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:39.254 21:05:33 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:39.254 21:05:33 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:39.254 21:05:33 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.254 21:05:33 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:39.254 21:05:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:39.254 21:05:33 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:39.254 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:39.254 21:05:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:39.254 21:05:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:39.254 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:39.254 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:39.254 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:39.254 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:39.254 21:05:33 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:39.254 21:05:33 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:39.254 21:05:33 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:39.254 21:05:33 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:39.254 21:05:33 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/devices.sh@116 -- # verify 0000:d8:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.254 21:05:33 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:39.254 21:05:33 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:39.254 21:05:33 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:39.254 21:05:33 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:39.254 21:05:33 -- setup/devices.sh@53 -- # local found=0 00:04:39.254 21:05:33 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:39.254 21:05:33 -- setup/devices.sh@56 -- # : 00:04:39.254 21:05:33 -- setup/devices.sh@59 -- # local pci status 00:04:39.254 21:05:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.254 21:05:33 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:39.254 21:05:33 -- setup/devices.sh@47 -- # setup output config 00:04:39.254 21:05:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.254 21:05:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:41.793 21:05:35 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:41.793 21:05:35 -- setup/devices.sh@63 -- # found=1 00:04:41.793 21:05:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.171 21:05:37 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:43.171 21:05:37 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:43.171 21:05:37 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.171 21:05:37 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:43.171 21:05:37 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:43.171 21:05:37 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.171 21:05:37 -- setup/devices.sh@125 -- # verify 0000:d8:00.0 data@nvme0n1 '' '' 00:04:43.171 21:05:37 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:43.171 21:05:37 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:43.171 21:05:37 -- setup/devices.sh@50 -- # local mount_point= 00:04:43.171 21:05:37 -- setup/devices.sh@51 -- # local test_file= 00:04:43.171 21:05:37 -- setup/devices.sh@53 -- # local found=0 00:04:43.171 21:05:37 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:43.171 21:05:37 -- setup/devices.sh@59 -- # local pci status 00:04:43.171 21:05:37 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.171 21:05:37 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:43.171 21:05:37 -- setup/devices.sh@47 -- # setup output config 00:04:43.171 21:05:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.171 21:05:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:45.714 21:05:39 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:45.714 21:05:39 -- setup/devices.sh@63 -- # found=1 00:04:45.714 21:05:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.092 21:05:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:47.092 21:05:40 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:47.092 21:05:40 -- setup/devices.sh@68 -- # return 0 00:04:47.092 21:05:40 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:47.092 21:05:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:47.092 21:05:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:47.092 21:05:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:47.092 21:05:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:47.092 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:47.092 00:04:47.092 real 0m13.749s 00:04:47.092 user 0m4.153s 00:04:47.092 sys 0m7.323s 00:04:47.092 21:05:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:47.092 21:05:40 -- common/autotest_common.sh@10 -- # set +x 00:04:47.092 ************************************ 00:04:47.092 END TEST nvme_mount 00:04:47.092 ************************************ 00:04:47.092 21:05:40 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:47.092 21:05:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.092 21:05:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.092 21:05:40 -- common/autotest_common.sh@10 -- # set +x 00:04:47.092 ************************************ 00:04:47.092 START TEST dm_mount 00:04:47.092 ************************************ 00:04:47.092 21:05:41 -- common/autotest_common.sh@1111 -- # dm_mount 00:04:47.092 21:05:41 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:47.092 21:05:41 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:47.092 21:05:41 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:47.092 21:05:41 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:47.092 21:05:41 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:47.092 21:05:41 -- setup/common.sh@40 -- # local part_no=2 00:04:47.092 21:05:41 -- setup/common.sh@41 -- # local size=1073741824 00:04:47.092 21:05:41 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:47.092 21:05:41 -- setup/common.sh@44 -- # parts=() 00:04:47.092 21:05:41 -- setup/common.sh@44 -- # local parts 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:47.092 21:05:41 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part++ )) 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:47.092 21:05:41 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part++ )) 00:04:47.092 21:05:41 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:47.092 21:05:41 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:47.092 21:05:41 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:47.092 21:05:41 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:48.030 Creating new GPT entries in memory. 00:04:48.030 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:48.030 other utilities. 00:04:48.030 21:05:42 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:48.030 21:05:42 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:48.030 21:05:42 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:48.030 21:05:42 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:48.030 21:05:42 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:48.968 Creating new GPT entries in memory. 00:04:48.968 The operation has completed successfully. 00:04:48.968 21:05:43 -- setup/common.sh@57 -- # (( part++ )) 00:04:48.968 21:05:43 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:48.968 21:05:43 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:48.968 21:05:43 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:48.968 21:05:43 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:50.347 The operation has completed successfully. 00:04:50.347 21:05:44 -- setup/common.sh@57 -- # (( part++ )) 00:04:50.347 21:05:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:50.347 21:05:44 -- setup/common.sh@62 -- # wait 1138224 00:04:50.347 21:05:44 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:50.347 21:05:44 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:50.347 21:05:44 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:50.347 21:05:44 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:50.347 21:05:44 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:50.347 21:05:44 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:50.347 21:05:44 -- setup/devices.sh@161 -- # break 00:04:50.347 21:05:44 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:50.347 21:05:44 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:50.347 21:05:44 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:50.347 21:05:44 -- setup/devices.sh@166 -- # dm=dm-0 00:04:50.347 21:05:44 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:50.347 21:05:44 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:50.347 21:05:44 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:50.347 21:05:44 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:04:50.347 21:05:44 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:50.347 21:05:44 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:50.347 21:05:44 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:50.347 21:05:44 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:50.347 21:05:44 -- setup/devices.sh@174 -- # verify 0000:d8:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:50.347 21:05:44 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:50.347 21:05:44 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:50.347 21:05:44 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:50.347 21:05:44 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:50.347 21:05:44 -- setup/devices.sh@53 -- # local found=0 00:04:50.348 21:05:44 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:50.348 21:05:44 -- setup/devices.sh@56 -- # : 00:04:50.348 21:05:44 -- setup/devices.sh@59 -- # local pci status 00:04:50.348 21:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.348 21:05:44 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:50.348 21:05:44 -- setup/devices.sh@47 -- # setup output config 00:04:50.348 21:05:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.348 21:05:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:52.912 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:52.913 21:05:46 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:52.913 21:05:46 -- setup/devices.sh@63 -- # found=1 00:04:52.913 21:05:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.291 21:05:48 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:54.291 21:05:48 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:54.291 21:05:48 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:54.291 21:05:48 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:54.291 21:05:48 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:54.291 21:05:48 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:54.291 21:05:48 -- setup/devices.sh@184 -- # verify 0000:d8:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:54.291 21:05:48 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:54.291 21:05:48 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:54.291 21:05:48 -- setup/devices.sh@50 -- # local mount_point= 00:04:54.291 21:05:48 -- setup/devices.sh@51 -- # local test_file= 00:04:54.291 21:05:48 -- setup/devices.sh@53 -- # local found=0 00:04:54.291 21:05:48 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:54.291 21:05:48 -- setup/devices.sh@59 -- # local pci status 00:04:54.291 21:05:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:54.291 21:05:48 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:54.291 21:05:48 -- setup/devices.sh@47 -- # setup output config 00:04:54.291 21:05:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:54.291 21:05:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.828 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.828 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:56.829 21:05:50 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:56.829 21:05:50 -- setup/devices.sh@63 -- # found=1 00:04:56.829 21:05:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.208 21:05:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:58.208 21:05:52 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:58.208 21:05:52 -- setup/devices.sh@68 -- # return 0 00:04:58.208 21:05:52 -- setup/devices.sh@187 -- # cleanup_dm 00:04:58.208 21:05:52 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:58.208 21:05:52 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:58.208 21:05:52 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:58.208 21:05:52 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.208 21:05:52 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:58.208 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:58.208 21:05:52 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:58.208 21:05:52 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:58.208 00:04:58.208 real 0m10.996s 00:04:58.208 user 0m2.890s 00:04:58.208 sys 0m5.107s 00:04:58.208 21:05:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.208 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:04:58.208 ************************************ 00:04:58.208 END TEST dm_mount 00:04:58.208 ************************************ 00:04:58.208 21:05:52 -- setup/devices.sh@1 -- # cleanup 00:04:58.208 21:05:52 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:58.208 21:05:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.208 21:05:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.208 21:05:52 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:58.208 21:05:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:58.209 21:05:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:58.209 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:58.209 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:58.209 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:58.209 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:58.209 21:05:52 -- setup/devices.sh@12 -- # cleanup_dm 00:04:58.209 21:05:52 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:58.209 21:05:52 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:58.209 21:05:52 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.209 21:05:52 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:58.209 21:05:52 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:58.209 21:05:52 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:58.209 00:04:58.209 real 0m29.173s 00:04:58.209 user 0m8.348s 00:04:58.209 sys 0m15.170s 00:04:58.209 21:05:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.209 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:04:58.209 ************************************ 00:04:58.209 END TEST devices 00:04:58.209 ************************************ 00:04:58.468 00:04:58.468 real 1m46.462s 00:04:58.468 user 0m31.466s 00:04:58.468 sys 0m56.751s 00:04:58.468 21:05:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.468 21:05:52 -- common/autotest_common.sh@10 -- # set +x 00:04:58.468 ************************************ 00:04:58.468 END TEST setup.sh 00:04:58.468 ************************************ 00:04:58.468 21:05:52 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:05:01.019 Hugepages 00:05:01.019 node hugesize free / total 00:05:01.019 node0 1048576kB 0 / 0 00:05:01.019 node0 2048kB 2048 / 2048 00:05:01.019 node1 1048576kB 0 / 0 00:05:01.019 node1 2048kB 0 / 0 00:05:01.019 00:05:01.019 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:01.019 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:05:01.019 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:05:01.277 NVMe 0000:d8:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:01.277 21:05:55 -- spdk/autotest.sh@130 -- # uname -s 00:05:01.277 21:05:55 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:05:01.277 21:05:55 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:05:01.277 21:05:55 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:03.811 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:03.811 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:07.101 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:05:08.476 21:06:02 -- common/autotest_common.sh@1518 -- # sleep 1 00:05:09.443 21:06:03 -- common/autotest_common.sh@1519 -- # bdfs=() 00:05:09.443 21:06:03 -- common/autotest_common.sh@1519 -- # local bdfs 00:05:09.443 21:06:03 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:05:09.443 21:06:03 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:05:09.443 21:06:03 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:09.443 21:06:03 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:09.443 21:06:03 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:09.443 21:06:03 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:09.443 21:06:03 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:09.443 21:06:03 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:09.443 21:06:03 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:05:09.443 21:06:03 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:05:11.975 Waiting for block devices as requested 00:05:11.975 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:11.975 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:11.975 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:11.975 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:11.975 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:12.234 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:12.234 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:12.234 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:12.234 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:12.492 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:12.492 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:12.492 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:12.751 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:12.751 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:12.751 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:12.751 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:13.018 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:05:14.412 21:06:08 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:05:14.412 21:06:08 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:d8:00.0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1488 -- # grep 0000:d8:00.0/nvme/nvme 00:05:14.412 21:06:08 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 ]] 00:05:14.412 21:06:08 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:05:14.412 21:06:08 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1531 -- # grep oacs 00:05:14.412 21:06:08 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:05:14.412 21:06:08 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:05:14.412 21:06:08 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:05:14.412 21:06:08 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:05:14.412 21:06:08 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:14.412 21:06:08 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:05:14.412 21:06:08 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:14.412 21:06:08 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:05:14.412 21:06:08 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:05:14.412 21:06:08 -- common/autotest_common.sh@1543 -- # continue 00:05:14.412 21:06:08 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:05:14.412 21:06:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:14.412 21:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:14.412 21:06:08 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:05:14.412 21:06:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:14.412 21:06:08 -- common/autotest_common.sh@10 -- # set +x 00:05:14.412 21:06:08 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:17.032 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:17.032 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:20.321 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:05:21.256 21:06:15 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:05:21.256 21:06:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:21.256 21:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:21.515 21:06:15 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:05:21.515 21:06:15 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:05:21.515 21:06:15 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:05:21.515 21:06:15 -- common/autotest_common.sh@1563 -- # bdfs=() 00:05:21.515 21:06:15 -- common/autotest_common.sh@1563 -- # local bdfs 00:05:21.515 21:06:15 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:05:21.515 21:06:15 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:21.515 21:06:15 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:21.515 21:06:15 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:21.515 21:06:15 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:21.515 21:06:15 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:21.515 21:06:15 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:21.515 21:06:15 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:05:21.515 21:06:15 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:05:21.515 21:06:15 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:d8:00.0/device 00:05:21.515 21:06:15 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:05:21.515 21:06:15 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:21.515 21:06:15 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:05:21.515 21:06:15 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:d8:00.0 00:05:21.515 21:06:15 -- common/autotest_common.sh@1578 -- # [[ -z 0000:d8:00.0 ]] 00:05:21.515 21:06:15 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=1149231 00:05:21.515 21:06:15 -- common/autotest_common.sh@1584 -- # waitforlisten 1149231 00:05:21.515 21:06:15 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:21.515 21:06:15 -- common/autotest_common.sh@817 -- # '[' -z 1149231 ']' 00:05:21.515 21:06:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.515 21:06:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:21.515 21:06:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.515 21:06:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:21.515 21:06:15 -- common/autotest_common.sh@10 -- # set +x 00:05:21.515 [2024-04-23 21:06:15.677208] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:21.515 [2024-04-23 21:06:15.677254] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149231 ] 00:05:21.515 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.515 [2024-04-23 21:06:15.729083] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.773 [2024-04-23 21:06:15.799884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.339 21:06:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:22.339 21:06:16 -- common/autotest_common.sh@850 -- # return 0 00:05:22.339 21:06:16 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:05:22.339 21:06:16 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:05:22.339 21:06:16 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:d8:00.0 00:05:25.621 nvme0n1 00:05:25.621 21:06:19 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:25.621 [2024-04-23 21:06:19.544700] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:05:25.621 request: 00:05:25.621 { 00:05:25.621 "nvme_ctrlr_name": "nvme0", 00:05:25.621 "password": "test", 00:05:25.621 "method": "bdev_nvme_opal_revert", 00:05:25.621 "req_id": 1 00:05:25.621 } 00:05:25.621 Got JSON-RPC error response 00:05:25.621 response: 00:05:25.621 { 00:05:25.621 "code": -32602, 00:05:25.621 "message": "Invalid parameters" 00:05:25.621 } 00:05:25.621 21:06:19 -- common/autotest_common.sh@1590 -- # true 00:05:25.621 21:06:19 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:05:25.621 21:06:19 -- common/autotest_common.sh@1594 -- # killprocess 1149231 00:05:25.621 21:06:19 -- common/autotest_common.sh@936 -- # '[' -z 1149231 ']' 00:05:25.621 21:06:19 -- common/autotest_common.sh@940 -- # kill -0 1149231 00:05:25.621 21:06:19 -- common/autotest_common.sh@941 -- # uname 00:05:25.621 21:06:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.621 21:06:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1149231 00:05:25.621 21:06:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.621 21:06:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.621 21:06:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1149231' 00:05:25.621 killing process with pid 1149231 00:05:25.621 21:06:19 -- common/autotest_common.sh@955 -- # kill 1149231 00:05:25.621 21:06:19 -- common/autotest_common.sh@960 -- # wait 1149231 00:05:29.801 21:06:23 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:05:29.801 21:06:23 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:05:29.801 21:06:23 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:29.801 21:06:23 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:29.801 21:06:23 -- spdk/autotest.sh@162 -- # timing_enter lib 00:05:29.801 21:06:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:29.801 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:29.801 21:06:23 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:05:29.801 21:06:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.801 21:06:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.801 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:29.801 ************************************ 00:05:29.801 START TEST env 00:05:29.801 ************************************ 00:05:29.801 21:06:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:05:29.801 * Looking for test storage... 00:05:29.801 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:05:29.801 21:06:23 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:05:29.801 21:06:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.801 21:06:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.801 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:29.801 ************************************ 00:05:29.801 START TEST env_memory 00:05:29.801 ************************************ 00:05:29.801 21:06:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:05:29.801 00:05:29.801 00:05:29.801 CUnit - A unit testing framework for C - Version 2.1-3 00:05:29.801 http://cunit.sourceforge.net/ 00:05:29.801 00:05:29.801 00:05:29.801 Suite: memory 00:05:29.801 Test: alloc and free memory map ...[2024-04-23 21:06:23.882392] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:29.801 passed 00:05:29.801 Test: mem map translation ...[2024-04-23 21:06:23.898650] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:29.801 [2024-04-23 21:06:23.898664] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:29.801 [2024-04-23 21:06:23.898695] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:29.801 [2024-04-23 21:06:23.898701] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:29.801 passed 00:05:29.801 Test: mem map registration ...[2024-04-23 21:06:23.931881] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:29.802 [2024-04-23 21:06:23.931895] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:29.802 passed 00:05:29.802 Test: mem map adjacent registrations ...passed 00:05:29.802 00:05:29.802 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.802 suites 1 1 n/a 0 0 00:05:29.802 tests 4 4 4 0 0 00:05:29.802 asserts 152 152 152 0 n/a 00:05:29.802 00:05:29.802 Elapsed time = 0.126 seconds 00:05:29.802 00:05:29.802 real 0m0.136s 00:05:29.802 user 0m0.127s 00:05:29.802 sys 0m0.009s 00:05:29.802 21:06:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:29.802 21:06:23 -- common/autotest_common.sh@10 -- # set +x 00:05:29.802 ************************************ 00:05:29.802 END TEST env_memory 00:05:29.802 ************************************ 00:05:29.802 21:06:24 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:29.802 21:06:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.802 21:06:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.802 21:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:30.060 ************************************ 00:05:30.060 START TEST env_vtophys 00:05:30.060 ************************************ 00:05:30.060 21:06:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:30.060 EAL: lib.eal log level changed from notice to debug 00:05:30.060 EAL: Detected lcore 0 as core 0 on socket 0 00:05:30.060 EAL: Detected lcore 1 as core 1 on socket 0 00:05:30.060 EAL: Detected lcore 2 as core 2 on socket 0 00:05:30.061 EAL: Detected lcore 3 as core 3 on socket 0 00:05:30.061 EAL: Detected lcore 4 as core 4 on socket 0 00:05:30.061 EAL: Detected lcore 5 as core 5 on socket 0 00:05:30.061 EAL: Detected lcore 6 as core 6 on socket 0 00:05:30.061 EAL: Detected lcore 7 as core 8 on socket 0 00:05:30.061 EAL: Detected lcore 8 as core 9 on socket 0 00:05:30.061 EAL: Detected lcore 9 as core 10 on socket 0 00:05:30.061 EAL: Detected lcore 10 as core 11 on socket 0 00:05:30.061 EAL: Detected lcore 11 as core 12 on socket 0 00:05:30.061 EAL: Detected lcore 12 as core 13 on socket 0 00:05:30.061 EAL: Detected lcore 13 as core 14 on socket 0 00:05:30.061 EAL: Detected lcore 14 as core 16 on socket 0 00:05:30.061 EAL: Detected lcore 15 as core 17 on socket 0 00:05:30.061 EAL: Detected lcore 16 as core 18 on socket 0 00:05:30.061 EAL: Detected lcore 17 as core 19 on socket 0 00:05:30.061 EAL: Detected lcore 18 as core 20 on socket 0 00:05:30.061 EAL: Detected lcore 19 as core 21 on socket 0 00:05:30.061 EAL: Detected lcore 20 as core 22 on socket 0 00:05:30.061 EAL: Detected lcore 21 as core 24 on socket 0 00:05:30.061 EAL: Detected lcore 22 as core 25 on socket 0 00:05:30.061 EAL: Detected lcore 23 as core 26 on socket 0 00:05:30.061 EAL: Detected lcore 24 as core 27 on socket 0 00:05:30.061 EAL: Detected lcore 25 as core 28 on socket 0 00:05:30.061 EAL: Detected lcore 26 as core 29 on socket 0 00:05:30.061 EAL: Detected lcore 27 as core 30 on socket 0 00:05:30.061 EAL: Detected lcore 28 as core 0 on socket 1 00:05:30.061 EAL: Detected lcore 29 as core 1 on socket 1 00:05:30.061 EAL: Detected lcore 30 as core 2 on socket 1 00:05:30.061 EAL: Detected lcore 31 as core 3 on socket 1 00:05:30.061 EAL: Detected lcore 32 as core 4 on socket 1 00:05:30.061 EAL: Detected lcore 33 as core 5 on socket 1 00:05:30.061 EAL: Detected lcore 34 as core 6 on socket 1 00:05:30.061 EAL: Detected lcore 35 as core 8 on socket 1 00:05:30.061 EAL: Detected lcore 36 as core 9 on socket 1 00:05:30.061 EAL: Detected lcore 37 as core 10 on socket 1 00:05:30.061 EAL: Detected lcore 38 as core 11 on socket 1 00:05:30.061 EAL: Detected lcore 39 as core 12 on socket 1 00:05:30.061 EAL: Detected lcore 40 as core 13 on socket 1 00:05:30.061 EAL: Detected lcore 41 as core 14 on socket 1 00:05:30.061 EAL: Detected lcore 42 as core 16 on socket 1 00:05:30.061 EAL: Detected lcore 43 as core 17 on socket 1 00:05:30.061 EAL: Detected lcore 44 as core 18 on socket 1 00:05:30.061 EAL: Detected lcore 45 as core 19 on socket 1 00:05:30.061 EAL: Detected lcore 46 as core 20 on socket 1 00:05:30.061 EAL: Detected lcore 47 as core 21 on socket 1 00:05:30.061 EAL: Detected lcore 48 as core 22 on socket 1 00:05:30.061 EAL: Detected lcore 49 as core 24 on socket 1 00:05:30.061 EAL: Detected lcore 50 as core 25 on socket 1 00:05:30.061 EAL: Detected lcore 51 as core 26 on socket 1 00:05:30.061 EAL: Detected lcore 52 as core 27 on socket 1 00:05:30.061 EAL: Detected lcore 53 as core 28 on socket 1 00:05:30.061 EAL: Detected lcore 54 as core 29 on socket 1 00:05:30.061 EAL: Detected lcore 55 as core 30 on socket 1 00:05:30.061 EAL: Detected lcore 56 as core 0 on socket 0 00:05:30.061 EAL: Detected lcore 57 as core 1 on socket 0 00:05:30.061 EAL: Detected lcore 58 as core 2 on socket 0 00:05:30.061 EAL: Detected lcore 59 as core 3 on socket 0 00:05:30.061 EAL: Detected lcore 60 as core 4 on socket 0 00:05:30.061 EAL: Detected lcore 61 as core 5 on socket 0 00:05:30.061 EAL: Detected lcore 62 as core 6 on socket 0 00:05:30.061 EAL: Detected lcore 63 as core 8 on socket 0 00:05:30.061 EAL: Detected lcore 64 as core 9 on socket 0 00:05:30.061 EAL: Detected lcore 65 as core 10 on socket 0 00:05:30.061 EAL: Detected lcore 66 as core 11 on socket 0 00:05:30.061 EAL: Detected lcore 67 as core 12 on socket 0 00:05:30.061 EAL: Detected lcore 68 as core 13 on socket 0 00:05:30.061 EAL: Detected lcore 69 as core 14 on socket 0 00:05:30.061 EAL: Detected lcore 70 as core 16 on socket 0 00:05:30.061 EAL: Detected lcore 71 as core 17 on socket 0 00:05:30.061 EAL: Detected lcore 72 as core 18 on socket 0 00:05:30.061 EAL: Detected lcore 73 as core 19 on socket 0 00:05:30.061 EAL: Detected lcore 74 as core 20 on socket 0 00:05:30.061 EAL: Detected lcore 75 as core 21 on socket 0 00:05:30.061 EAL: Detected lcore 76 as core 22 on socket 0 00:05:30.061 EAL: Detected lcore 77 as core 24 on socket 0 00:05:30.061 EAL: Detected lcore 78 as core 25 on socket 0 00:05:30.061 EAL: Detected lcore 79 as core 26 on socket 0 00:05:30.061 EAL: Detected lcore 80 as core 27 on socket 0 00:05:30.061 EAL: Detected lcore 81 as core 28 on socket 0 00:05:30.061 EAL: Detected lcore 82 as core 29 on socket 0 00:05:30.061 EAL: Detected lcore 83 as core 30 on socket 0 00:05:30.061 EAL: Detected lcore 84 as core 0 on socket 1 00:05:30.061 EAL: Detected lcore 85 as core 1 on socket 1 00:05:30.061 EAL: Detected lcore 86 as core 2 on socket 1 00:05:30.061 EAL: Detected lcore 87 as core 3 on socket 1 00:05:30.061 EAL: Detected lcore 88 as core 4 on socket 1 00:05:30.061 EAL: Detected lcore 89 as core 5 on socket 1 00:05:30.061 EAL: Detected lcore 90 as core 6 on socket 1 00:05:30.061 EAL: Detected lcore 91 as core 8 on socket 1 00:05:30.061 EAL: Detected lcore 92 as core 9 on socket 1 00:05:30.061 EAL: Detected lcore 93 as core 10 on socket 1 00:05:30.061 EAL: Detected lcore 94 as core 11 on socket 1 00:05:30.061 EAL: Detected lcore 95 as core 12 on socket 1 00:05:30.061 EAL: Detected lcore 96 as core 13 on socket 1 00:05:30.061 EAL: Detected lcore 97 as core 14 on socket 1 00:05:30.061 EAL: Detected lcore 98 as core 16 on socket 1 00:05:30.061 EAL: Detected lcore 99 as core 17 on socket 1 00:05:30.061 EAL: Detected lcore 100 as core 18 on socket 1 00:05:30.061 EAL: Detected lcore 101 as core 19 on socket 1 00:05:30.061 EAL: Detected lcore 102 as core 20 on socket 1 00:05:30.061 EAL: Detected lcore 103 as core 21 on socket 1 00:05:30.061 EAL: Detected lcore 104 as core 22 on socket 1 00:05:30.061 EAL: Detected lcore 105 as core 24 on socket 1 00:05:30.061 EAL: Detected lcore 106 as core 25 on socket 1 00:05:30.061 EAL: Detected lcore 107 as core 26 on socket 1 00:05:30.061 EAL: Detected lcore 108 as core 27 on socket 1 00:05:30.061 EAL: Detected lcore 109 as core 28 on socket 1 00:05:30.061 EAL: Detected lcore 110 as core 29 on socket 1 00:05:30.061 EAL: Detected lcore 111 as core 30 on socket 1 00:05:30.061 EAL: Maximum logical cores by configuration: 128 00:05:30.061 EAL: Detected CPU lcores: 112 00:05:30.061 EAL: Detected NUMA nodes: 2 00:05:30.061 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:30.061 EAL: Detected shared linkage of DPDK 00:05:30.061 EAL: No shared files mode enabled, IPC will be disabled 00:05:30.061 EAL: Bus pci wants IOVA as 'DC' 00:05:30.061 EAL: Buses did not request a specific IOVA mode. 00:05:30.061 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:30.061 EAL: Selected IOVA mode 'VA' 00:05:30.061 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.061 EAL: Probing VFIO support... 00:05:30.061 EAL: IOMMU type 1 (Type 1) is supported 00:05:30.061 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:30.061 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:30.061 EAL: VFIO support initialized 00:05:30.061 EAL: Ask a virtual area of 0x2e000 bytes 00:05:30.061 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:30.061 EAL: Setting up physically contiguous memory... 00:05:30.061 EAL: Setting maximum number of open files to 524288 00:05:30.061 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:30.061 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:30.061 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:30.061 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.061 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:30.061 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:30.061 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.061 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:30.061 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:30.061 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.061 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:30.061 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:30.061 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.061 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:30.061 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:30.061 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.061 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:30.061 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:30.061 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.061 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:30.061 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:30.061 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.061 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:30.061 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:30.061 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.061 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:30.061 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:30.061 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:30.061 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.061 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:30.062 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:30.062 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.062 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:30.062 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:30.062 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.062 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:30.062 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:30.062 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.062 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:30.062 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:30.062 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.062 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:30.062 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:30.062 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.062 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:30.062 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:30.062 EAL: Ask a virtual area of 0x61000 bytes 00:05:30.062 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:30.062 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:30.062 EAL: Ask a virtual area of 0x400000000 bytes 00:05:30.062 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:30.062 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:30.062 EAL: Hugepages will be freed exactly as allocated. 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: TSC frequency is ~2700000 KHz 00:05:30.062 EAL: Main lcore 0 is ready (tid=7f3705799a00;cpuset=[0]) 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 0 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 2MB 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:30.062 EAL: Mem event callback 'spdk:(nil)' registered 00:05:30.062 00:05:30.062 00:05:30.062 CUnit - A unit testing framework for C - Version 2.1-3 00:05:30.062 http://cunit.sourceforge.net/ 00:05:30.062 00:05:30.062 00:05:30.062 Suite: components_suite 00:05:30.062 Test: vtophys_malloc_test ...passed 00:05:30.062 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 4MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 4MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 6MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 6MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 10MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 10MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 18MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 18MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 34MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 34MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 66MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 66MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.062 EAL: Restoring previous memory policy: 4 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was expanded by 130MB 00:05:30.062 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.062 EAL: request: mp_malloc_sync 00:05:30.062 EAL: No shared files mode enabled, IPC is disabled 00:05:30.062 EAL: Heap on socket 0 was shrunk by 130MB 00:05:30.062 EAL: Trying to obtain current memory policy. 00:05:30.062 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.321 EAL: Restoring previous memory policy: 4 00:05:30.321 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.321 EAL: request: mp_malloc_sync 00:05:30.321 EAL: No shared files mode enabled, IPC is disabled 00:05:30.321 EAL: Heap on socket 0 was expanded by 258MB 00:05:30.321 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.321 EAL: request: mp_malloc_sync 00:05:30.321 EAL: No shared files mode enabled, IPC is disabled 00:05:30.321 EAL: Heap on socket 0 was shrunk by 258MB 00:05:30.321 EAL: Trying to obtain current memory policy. 00:05:30.321 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.321 EAL: Restoring previous memory policy: 4 00:05:30.321 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.321 EAL: request: mp_malloc_sync 00:05:30.321 EAL: No shared files mode enabled, IPC is disabled 00:05:30.321 EAL: Heap on socket 0 was expanded by 514MB 00:05:30.579 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.579 EAL: request: mp_malloc_sync 00:05:30.579 EAL: No shared files mode enabled, IPC is disabled 00:05:30.579 EAL: Heap on socket 0 was shrunk by 514MB 00:05:30.579 EAL: Trying to obtain current memory policy. 00:05:30.579 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.838 EAL: Restoring previous memory policy: 4 00:05:30.838 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.838 EAL: request: mp_malloc_sync 00:05:30.838 EAL: No shared files mode enabled, IPC is disabled 00:05:30.838 EAL: Heap on socket 0 was expanded by 1026MB 00:05:30.838 EAL: Calling mem event callback 'spdk:(nil)' 00:05:31.096 EAL: request: mp_malloc_sync 00:05:31.096 EAL: No shared files mode enabled, IPC is disabled 00:05:31.096 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:31.096 passed 00:05:31.096 00:05:31.096 Run Summary: Type Total Ran Passed Failed Inactive 00:05:31.096 suites 1 1 n/a 0 0 00:05:31.096 tests 2 2 2 0 0 00:05:31.096 asserts 497 497 497 0 n/a 00:05:31.096 00:05:31.096 Elapsed time = 0.947 seconds 00:05:31.096 EAL: Calling mem event callback 'spdk:(nil)' 00:05:31.096 EAL: request: mp_malloc_sync 00:05:31.096 EAL: No shared files mode enabled, IPC is disabled 00:05:31.096 EAL: Heap on socket 0 was shrunk by 2MB 00:05:31.096 EAL: No shared files mode enabled, IPC is disabled 00:05:31.096 EAL: No shared files mode enabled, IPC is disabled 00:05:31.096 EAL: No shared files mode enabled, IPC is disabled 00:05:31.096 00:05:31.096 real 0m1.058s 00:05:31.096 user 0m0.626s 00:05:31.096 sys 0m0.400s 00:05:31.096 21:06:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.096 21:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:31.096 ************************************ 00:05:31.096 END TEST env_vtophys 00:05:31.096 ************************************ 00:05:31.096 21:06:25 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:05:31.096 21:06:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.096 21:06:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.096 21:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:31.096 ************************************ 00:05:31.096 START TEST env_pci 00:05:31.096 ************************************ 00:05:31.096 21:06:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:05:31.096 00:05:31.096 00:05:31.096 CUnit - A unit testing framework for C - Version 2.1-3 00:05:31.096 http://cunit.sourceforge.net/ 00:05:31.096 00:05:31.096 00:05:31.096 Suite: pci 00:05:31.096 Test: pci_hook ...[2024-04-23 21:06:25.342842] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1151180 has claimed it 00:05:31.355 EAL: Cannot find device (10000:00:01.0) 00:05:31.355 EAL: Failed to attach device on primary process 00:05:31.355 passed 00:05:31.355 00:05:31.355 Run Summary: Type Total Ran Passed Failed Inactive 00:05:31.355 suites 1 1 n/a 0 0 00:05:31.355 tests 1 1 1 0 0 00:05:31.355 asserts 25 25 25 0 n/a 00:05:31.355 00:05:31.355 Elapsed time = 0.027 seconds 00:05:31.355 00:05:31.355 real 0m0.045s 00:05:31.355 user 0m0.015s 00:05:31.355 sys 0m0.030s 00:05:31.355 21:06:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.355 21:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:31.355 ************************************ 00:05:31.355 END TEST env_pci 00:05:31.355 ************************************ 00:05:31.355 21:06:25 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:31.355 21:06:25 -- env/env.sh@15 -- # uname 00:05:31.355 21:06:25 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:31.355 21:06:25 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:31.355 21:06:25 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:31.355 21:06:25 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:31.355 21:06:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.355 21:06:25 -- common/autotest_common.sh@10 -- # set +x 00:05:31.355 ************************************ 00:05:31.355 START TEST env_dpdk_post_init 00:05:31.355 ************************************ 00:05:31.355 21:06:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:31.355 EAL: Detected CPU lcores: 112 00:05:31.355 EAL: Detected NUMA nodes: 2 00:05:31.355 EAL: Detected shared linkage of DPDK 00:05:31.355 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:31.355 EAL: Selected IOVA mode 'VA' 00:05:31.355 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.355 EAL: VFIO support initialized 00:05:31.355 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:31.616 EAL: Using IOMMU type 1 (Type 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:05:31.616 EAL: Ignore mapping IO port bar(1) 00:05:31.616 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:05:32.552 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:d8:00.0 (socket 1) 00:05:37.815 EAL: Releasing PCI mapped resource for 0000:d8:00.0 00:05:37.815 EAL: Calling pci_unmap_resource for 0000:d8:00.0 at 0x202001040000 00:05:38.073 Starting DPDK initialization... 00:05:38.073 Starting SPDK post initialization... 00:05:38.073 SPDK NVMe probe 00:05:38.073 Attaching to 0000:d8:00.0 00:05:38.073 Attached to 0000:d8:00.0 00:05:38.073 Cleaning up... 00:05:38.073 00:05:38.073 real 0m6.631s 00:05:38.073 user 0m5.462s 00:05:38.073 sys 0m0.237s 00:05:38.073 21:06:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.073 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.073 ************************************ 00:05:38.073 END TEST env_dpdk_post_init 00:05:38.073 ************************************ 00:05:38.073 21:06:32 -- env/env.sh@26 -- # uname 00:05:38.073 21:06:32 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:38.073 21:06:32 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:38.073 21:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.073 21:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.073 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.073 ************************************ 00:05:38.073 START TEST env_mem_callbacks 00:05:38.073 ************************************ 00:05:38.073 21:06:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:38.073 EAL: Detected CPU lcores: 112 00:05:38.073 EAL: Detected NUMA nodes: 2 00:05:38.073 EAL: Detected shared linkage of DPDK 00:05:38.073 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:38.073 EAL: Selected IOVA mode 'VA' 00:05:38.073 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.073 EAL: VFIO support initialized 00:05:38.073 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:38.073 00:05:38.073 00:05:38.073 CUnit - A unit testing framework for C - Version 2.1-3 00:05:38.073 http://cunit.sourceforge.net/ 00:05:38.073 00:05:38.073 00:05:38.073 Suite: memory 00:05:38.073 Test: test ... 00:05:38.073 register 0x200000200000 2097152 00:05:38.073 malloc 3145728 00:05:38.073 register 0x200000400000 4194304 00:05:38.073 buf 0x200000500000 len 3145728 PASSED 00:05:38.073 malloc 64 00:05:38.073 buf 0x2000004fff40 len 64 PASSED 00:05:38.073 malloc 4194304 00:05:38.073 register 0x200000800000 6291456 00:05:38.073 buf 0x200000a00000 len 4194304 PASSED 00:05:38.073 free 0x200000500000 3145728 00:05:38.073 free 0x2000004fff40 64 00:05:38.073 unregister 0x200000400000 4194304 PASSED 00:05:38.073 free 0x200000a00000 4194304 00:05:38.073 unregister 0x200000800000 6291456 PASSED 00:05:38.073 malloc 8388608 00:05:38.331 register 0x200000400000 10485760 00:05:38.331 buf 0x200000600000 len 8388608 PASSED 00:05:38.332 free 0x200000600000 8388608 00:05:38.332 unregister 0x200000400000 10485760 PASSED 00:05:38.332 passed 00:05:38.332 00:05:38.332 Run Summary: Type Total Ran Passed Failed Inactive 00:05:38.332 suites 1 1 n/a 0 0 00:05:38.332 tests 1 1 1 0 0 00:05:38.332 asserts 15 15 15 0 n/a 00:05:38.332 00:05:38.332 Elapsed time = 0.004 seconds 00:05:38.332 00:05:38.332 real 0m0.050s 00:05:38.332 user 0m0.020s 00:05:38.332 sys 0m0.030s 00:05:38.332 21:06:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.332 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.332 ************************************ 00:05:38.332 END TEST env_mem_callbacks 00:05:38.332 ************************************ 00:05:38.332 00:05:38.332 real 0m8.737s 00:05:38.332 user 0m6.556s 00:05:38.332 sys 0m1.158s 00:05:38.332 21:06:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.332 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.332 ************************************ 00:05:38.332 END TEST env 00:05:38.332 ************************************ 00:05:38.332 21:06:32 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:05:38.332 21:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.332 21:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.332 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.332 ************************************ 00:05:38.332 START TEST rpc 00:05:38.332 ************************************ 00:05:38.332 21:06:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:05:38.590 * Looking for test storage... 00:05:38.590 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:38.590 21:06:32 -- rpc/rpc.sh@65 -- # spdk_pid=1152636 00:05:38.590 21:06:32 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:38.590 21:06:32 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:38.590 21:06:32 -- rpc/rpc.sh@67 -- # waitforlisten 1152636 00:05:38.590 21:06:32 -- common/autotest_common.sh@817 -- # '[' -z 1152636 ']' 00:05:38.590 21:06:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:38.590 21:06:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:38.590 21:06:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:38.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:38.590 21:06:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:38.590 21:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:38.590 [2024-04-23 21:06:32.672492] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:38.590 [2024-04-23 21:06:32.672537] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1152636 ] 00:05:38.590 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.590 [2024-04-23 21:06:32.724090] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.590 [2024-04-23 21:06:32.790897] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:38.590 [2024-04-23 21:06:32.790938] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1152636' to capture a snapshot of events at runtime. 00:05:38.590 [2024-04-23 21:06:32.790944] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:38.590 [2024-04-23 21:06:32.790950] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:38.590 [2024-04-23 21:06:32.790954] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1152636 for offline analysis/debug. 00:05:38.590 [2024-04-23 21:06:32.790974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.522 21:06:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:39.522 21:06:33 -- common/autotest_common.sh@850 -- # return 0 00:05:39.522 21:06:33 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:39.522 21:06:33 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:39.522 21:06:33 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:39.522 21:06:33 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:39.522 21:06:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.522 21:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.522 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.522 ************************************ 00:05:39.522 START TEST rpc_integrity 00:05:39.522 ************************************ 00:05:39.522 21:06:33 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:39.522 21:06:33 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:39.522 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.522 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.522 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.522 21:06:33 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:39.522 21:06:33 -- rpc/rpc.sh@13 -- # jq length 00:05:39.522 21:06:33 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:39.522 21:06:33 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:39.522 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.522 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.522 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.522 21:06:33 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:39.522 21:06:33 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:39.522 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.522 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.522 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.522 21:06:33 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:39.523 { 00:05:39.523 "name": "Malloc0", 00:05:39.523 "aliases": [ 00:05:39.523 "191621e4-6747-4a81-be69-a8a62be8931a" 00:05:39.523 ], 00:05:39.523 "product_name": "Malloc disk", 00:05:39.523 "block_size": 512, 00:05:39.523 "num_blocks": 16384, 00:05:39.523 "uuid": "191621e4-6747-4a81-be69-a8a62be8931a", 00:05:39.523 "assigned_rate_limits": { 00:05:39.523 "rw_ios_per_sec": 0, 00:05:39.523 "rw_mbytes_per_sec": 0, 00:05:39.523 "r_mbytes_per_sec": 0, 00:05:39.523 "w_mbytes_per_sec": 0 00:05:39.523 }, 00:05:39.523 "claimed": false, 00:05:39.523 "zoned": false, 00:05:39.523 "supported_io_types": { 00:05:39.523 "read": true, 00:05:39.523 "write": true, 00:05:39.523 "unmap": true, 00:05:39.523 "write_zeroes": true, 00:05:39.523 "flush": true, 00:05:39.523 "reset": true, 00:05:39.523 "compare": false, 00:05:39.523 "compare_and_write": false, 00:05:39.523 "abort": true, 00:05:39.523 "nvme_admin": false, 00:05:39.523 "nvme_io": false 00:05:39.523 }, 00:05:39.523 "memory_domains": [ 00:05:39.523 { 00:05:39.523 "dma_device_id": "system", 00:05:39.523 "dma_device_type": 1 00:05:39.523 }, 00:05:39.523 { 00:05:39.523 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.523 "dma_device_type": 2 00:05:39.523 } 00:05:39.523 ], 00:05:39.523 "driver_specific": {} 00:05:39.523 } 00:05:39.523 ]' 00:05:39.523 21:06:33 -- rpc/rpc.sh@17 -- # jq length 00:05:39.523 21:06:33 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:39.523 21:06:33 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:39.523 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 [2024-04-23 21:06:33.658909] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:39.523 [2024-04-23 21:06:33.658938] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:39.523 [2024-04-23 21:06:33.658948] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xe986b0 00:05:39.523 [2024-04-23 21:06:33.658953] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:39.523 [2024-04-23 21:06:33.659945] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:39.523 [2024-04-23 21:06:33.659966] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:39.523 Passthru0 00:05:39.523 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.523 21:06:33 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:39.523 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.523 21:06:33 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:39.523 { 00:05:39.523 "name": "Malloc0", 00:05:39.523 "aliases": [ 00:05:39.523 "191621e4-6747-4a81-be69-a8a62be8931a" 00:05:39.523 ], 00:05:39.523 "product_name": "Malloc disk", 00:05:39.523 "block_size": 512, 00:05:39.523 "num_blocks": 16384, 00:05:39.523 "uuid": "191621e4-6747-4a81-be69-a8a62be8931a", 00:05:39.523 "assigned_rate_limits": { 00:05:39.523 "rw_ios_per_sec": 0, 00:05:39.523 "rw_mbytes_per_sec": 0, 00:05:39.523 "r_mbytes_per_sec": 0, 00:05:39.523 "w_mbytes_per_sec": 0 00:05:39.523 }, 00:05:39.523 "claimed": true, 00:05:39.523 "claim_type": "exclusive_write", 00:05:39.523 "zoned": false, 00:05:39.523 "supported_io_types": { 00:05:39.523 "read": true, 00:05:39.523 "write": true, 00:05:39.523 "unmap": true, 00:05:39.523 "write_zeroes": true, 00:05:39.523 "flush": true, 00:05:39.523 "reset": true, 00:05:39.523 "compare": false, 00:05:39.523 "compare_and_write": false, 00:05:39.523 "abort": true, 00:05:39.523 "nvme_admin": false, 00:05:39.523 "nvme_io": false 00:05:39.523 }, 00:05:39.523 "memory_domains": [ 00:05:39.523 { 00:05:39.523 "dma_device_id": "system", 00:05:39.523 "dma_device_type": 1 00:05:39.523 }, 00:05:39.523 { 00:05:39.523 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.523 "dma_device_type": 2 00:05:39.523 } 00:05:39.523 ], 00:05:39.523 "driver_specific": {} 00:05:39.523 }, 00:05:39.523 { 00:05:39.523 "name": "Passthru0", 00:05:39.523 "aliases": [ 00:05:39.523 "96dc30a0-1853-55d3-a0bf-7a4ca4a30675" 00:05:39.523 ], 00:05:39.523 "product_name": "passthru", 00:05:39.523 "block_size": 512, 00:05:39.523 "num_blocks": 16384, 00:05:39.523 "uuid": "96dc30a0-1853-55d3-a0bf-7a4ca4a30675", 00:05:39.523 "assigned_rate_limits": { 00:05:39.523 "rw_ios_per_sec": 0, 00:05:39.523 "rw_mbytes_per_sec": 0, 00:05:39.523 "r_mbytes_per_sec": 0, 00:05:39.523 "w_mbytes_per_sec": 0 00:05:39.523 }, 00:05:39.523 "claimed": false, 00:05:39.523 "zoned": false, 00:05:39.523 "supported_io_types": { 00:05:39.523 "read": true, 00:05:39.523 "write": true, 00:05:39.523 "unmap": true, 00:05:39.523 "write_zeroes": true, 00:05:39.523 "flush": true, 00:05:39.523 "reset": true, 00:05:39.523 "compare": false, 00:05:39.523 "compare_and_write": false, 00:05:39.523 "abort": true, 00:05:39.523 "nvme_admin": false, 00:05:39.523 "nvme_io": false 00:05:39.523 }, 00:05:39.523 "memory_domains": [ 00:05:39.523 { 00:05:39.523 "dma_device_id": "system", 00:05:39.523 "dma_device_type": 1 00:05:39.523 }, 00:05:39.523 { 00:05:39.523 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.523 "dma_device_type": 2 00:05:39.523 } 00:05:39.523 ], 00:05:39.523 "driver_specific": { 00:05:39.523 "passthru": { 00:05:39.523 "name": "Passthru0", 00:05:39.523 "base_bdev_name": "Malloc0" 00:05:39.523 } 00:05:39.523 } 00:05:39.523 } 00:05:39.523 ]' 00:05:39.523 21:06:33 -- rpc/rpc.sh@21 -- # jq length 00:05:39.523 21:06:33 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:39.523 21:06:33 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:39.523 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.523 21:06:33 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:39.523 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.523 21:06:33 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:39.523 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.523 21:06:33 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:39.523 21:06:33 -- rpc/rpc.sh@26 -- # jq length 00:05:39.523 21:06:33 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:39.523 00:05:39.523 real 0m0.260s 00:05:39.523 user 0m0.155s 00:05:39.523 sys 0m0.037s 00:05:39.523 21:06:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.523 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.523 ************************************ 00:05:39.523 END TEST rpc_integrity 00:05:39.523 ************************************ 00:05:39.781 21:06:33 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:39.781 21:06:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.781 21:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.781 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.781 ************************************ 00:05:39.781 START TEST rpc_plugins 00:05:39.781 ************************************ 00:05:39.781 21:06:33 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:05:39.781 21:06:33 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:39.781 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.781 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.781 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.781 21:06:33 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:39.781 21:06:33 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:39.781 21:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.781 21:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:39.781 21:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.781 21:06:33 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:39.781 { 00:05:39.781 "name": "Malloc1", 00:05:39.781 "aliases": [ 00:05:39.781 "86f4b1cb-a5a5-4f13-b535-52988b8ec794" 00:05:39.781 ], 00:05:39.781 "product_name": "Malloc disk", 00:05:39.781 "block_size": 4096, 00:05:39.781 "num_blocks": 256, 00:05:39.781 "uuid": "86f4b1cb-a5a5-4f13-b535-52988b8ec794", 00:05:39.781 "assigned_rate_limits": { 00:05:39.781 "rw_ios_per_sec": 0, 00:05:39.781 "rw_mbytes_per_sec": 0, 00:05:39.781 "r_mbytes_per_sec": 0, 00:05:39.781 "w_mbytes_per_sec": 0 00:05:39.781 }, 00:05:39.781 "claimed": false, 00:05:39.781 "zoned": false, 00:05:39.782 "supported_io_types": { 00:05:39.782 "read": true, 00:05:39.782 "write": true, 00:05:39.782 "unmap": true, 00:05:39.782 "write_zeroes": true, 00:05:39.782 "flush": true, 00:05:39.782 "reset": true, 00:05:39.782 "compare": false, 00:05:39.782 "compare_and_write": false, 00:05:39.782 "abort": true, 00:05:39.782 "nvme_admin": false, 00:05:39.782 "nvme_io": false 00:05:39.782 }, 00:05:39.782 "memory_domains": [ 00:05:39.782 { 00:05:39.782 "dma_device_id": "system", 00:05:39.782 "dma_device_type": 1 00:05:39.782 }, 00:05:39.782 { 00:05:39.782 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.782 "dma_device_type": 2 00:05:39.782 } 00:05:39.782 ], 00:05:39.782 "driver_specific": {} 00:05:39.782 } 00:05:39.782 ]' 00:05:39.782 21:06:33 -- rpc/rpc.sh@32 -- # jq length 00:05:39.782 21:06:34 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:39.782 21:06:34 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:39.782 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.782 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:39.782 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.782 21:06:34 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:39.782 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.782 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:39.782 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.782 21:06:34 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:39.782 21:06:34 -- rpc/rpc.sh@36 -- # jq length 00:05:40.040 21:06:34 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:40.040 00:05:40.040 real 0m0.132s 00:05:40.040 user 0m0.083s 00:05:40.040 sys 0m0.016s 00:05:40.040 21:06:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.040 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.040 ************************************ 00:05:40.040 END TEST rpc_plugins 00:05:40.040 ************************************ 00:05:40.040 21:06:34 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:40.040 21:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.040 21:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.040 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.040 ************************************ 00:05:40.040 START TEST rpc_trace_cmd_test 00:05:40.040 ************************************ 00:05:40.040 21:06:34 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:05:40.040 21:06:34 -- rpc/rpc.sh@40 -- # local info 00:05:40.040 21:06:34 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:40.040 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.040 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.040 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.040 21:06:34 -- rpc/rpc.sh@42 -- # info='{ 00:05:40.040 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1152636", 00:05:40.040 "tpoint_group_mask": "0x8", 00:05:40.040 "iscsi_conn": { 00:05:40.040 "mask": "0x2", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "scsi": { 00:05:40.040 "mask": "0x4", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "bdev": { 00:05:40.040 "mask": "0x8", 00:05:40.040 "tpoint_mask": "0xffffffffffffffff" 00:05:40.040 }, 00:05:40.040 "nvmf_rdma": { 00:05:40.040 "mask": "0x10", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "nvmf_tcp": { 00:05:40.040 "mask": "0x20", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "ftl": { 00:05:40.040 "mask": "0x40", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "blobfs": { 00:05:40.040 "mask": "0x80", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "dsa": { 00:05:40.040 "mask": "0x200", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "thread": { 00:05:40.040 "mask": "0x400", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "nvme_pcie": { 00:05:40.040 "mask": "0x800", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "iaa": { 00:05:40.040 "mask": "0x1000", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "nvme_tcp": { 00:05:40.040 "mask": "0x2000", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "bdev_nvme": { 00:05:40.040 "mask": "0x4000", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 }, 00:05:40.040 "sock": { 00:05:40.040 "mask": "0x8000", 00:05:40.040 "tpoint_mask": "0x0" 00:05:40.040 } 00:05:40.040 }' 00:05:40.040 21:06:34 -- rpc/rpc.sh@43 -- # jq length 00:05:40.040 21:06:34 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:05:40.040 21:06:34 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:40.298 21:06:34 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:40.298 21:06:34 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:40.298 21:06:34 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:40.298 21:06:34 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:40.298 21:06:34 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:40.298 21:06:34 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:40.298 21:06:34 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:40.298 00:05:40.298 real 0m0.207s 00:05:40.298 user 0m0.169s 00:05:40.298 sys 0m0.029s 00:05:40.298 21:06:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.298 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.298 ************************************ 00:05:40.298 END TEST rpc_trace_cmd_test 00:05:40.298 ************************************ 00:05:40.298 21:06:34 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:40.298 21:06:34 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:40.298 21:06:34 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:40.298 21:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.298 21:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.298 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 ************************************ 00:05:40.556 START TEST rpc_daemon_integrity 00:05:40.556 ************************************ 00:05:40.556 21:06:34 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:40.556 21:06:34 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.556 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.556 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.556 21:06:34 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:40.556 21:06:34 -- rpc/rpc.sh@13 -- # jq length 00:05:40.556 21:06:34 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:40.556 21:06:34 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:40.556 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.556 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.556 21:06:34 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:40.556 21:06:34 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:40.556 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.556 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.556 21:06:34 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:40.556 { 00:05:40.556 "name": "Malloc2", 00:05:40.556 "aliases": [ 00:05:40.556 "f67ad366-b96e-4b0b-8515-625ce44c88be" 00:05:40.556 ], 00:05:40.556 "product_name": "Malloc disk", 00:05:40.556 "block_size": 512, 00:05:40.556 "num_blocks": 16384, 00:05:40.556 "uuid": "f67ad366-b96e-4b0b-8515-625ce44c88be", 00:05:40.556 "assigned_rate_limits": { 00:05:40.556 "rw_ios_per_sec": 0, 00:05:40.556 "rw_mbytes_per_sec": 0, 00:05:40.556 "r_mbytes_per_sec": 0, 00:05:40.556 "w_mbytes_per_sec": 0 00:05:40.556 }, 00:05:40.556 "claimed": false, 00:05:40.556 "zoned": false, 00:05:40.556 "supported_io_types": { 00:05:40.556 "read": true, 00:05:40.556 "write": true, 00:05:40.556 "unmap": true, 00:05:40.556 "write_zeroes": true, 00:05:40.556 "flush": true, 00:05:40.556 "reset": true, 00:05:40.556 "compare": false, 00:05:40.556 "compare_and_write": false, 00:05:40.556 "abort": true, 00:05:40.556 "nvme_admin": false, 00:05:40.556 "nvme_io": false 00:05:40.556 }, 00:05:40.556 "memory_domains": [ 00:05:40.556 { 00:05:40.556 "dma_device_id": "system", 00:05:40.556 "dma_device_type": 1 00:05:40.556 }, 00:05:40.556 { 00:05:40.556 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.556 "dma_device_type": 2 00:05:40.556 } 00:05:40.556 ], 00:05:40.556 "driver_specific": {} 00:05:40.556 } 00:05:40.556 ]' 00:05:40.556 21:06:34 -- rpc/rpc.sh@17 -- # jq length 00:05:40.556 21:06:34 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:40.556 21:06:34 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:40.556 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.556 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 [2024-04-23 21:06:34.713684] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:40.556 [2024-04-23 21:06:34.713712] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:40.556 [2024-04-23 21:06:34.713721] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xe98b80 00:05:40.556 [2024-04-23 21:06:34.713726] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:40.556 [2024-04-23 21:06:34.714645] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:40.556 [2024-04-23 21:06:34.714665] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:40.556 Passthru0 00:05:40.556 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.556 21:06:34 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:40.556 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.556 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.556 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.557 21:06:34 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:40.557 { 00:05:40.557 "name": "Malloc2", 00:05:40.557 "aliases": [ 00:05:40.557 "f67ad366-b96e-4b0b-8515-625ce44c88be" 00:05:40.557 ], 00:05:40.557 "product_name": "Malloc disk", 00:05:40.557 "block_size": 512, 00:05:40.557 "num_blocks": 16384, 00:05:40.557 "uuid": "f67ad366-b96e-4b0b-8515-625ce44c88be", 00:05:40.557 "assigned_rate_limits": { 00:05:40.557 "rw_ios_per_sec": 0, 00:05:40.557 "rw_mbytes_per_sec": 0, 00:05:40.557 "r_mbytes_per_sec": 0, 00:05:40.557 "w_mbytes_per_sec": 0 00:05:40.557 }, 00:05:40.557 "claimed": true, 00:05:40.557 "claim_type": "exclusive_write", 00:05:40.557 "zoned": false, 00:05:40.557 "supported_io_types": { 00:05:40.557 "read": true, 00:05:40.557 "write": true, 00:05:40.557 "unmap": true, 00:05:40.557 "write_zeroes": true, 00:05:40.557 "flush": true, 00:05:40.557 "reset": true, 00:05:40.557 "compare": false, 00:05:40.557 "compare_and_write": false, 00:05:40.557 "abort": true, 00:05:40.557 "nvme_admin": false, 00:05:40.557 "nvme_io": false 00:05:40.557 }, 00:05:40.557 "memory_domains": [ 00:05:40.557 { 00:05:40.557 "dma_device_id": "system", 00:05:40.557 "dma_device_type": 1 00:05:40.557 }, 00:05:40.557 { 00:05:40.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.557 "dma_device_type": 2 00:05:40.557 } 00:05:40.557 ], 00:05:40.557 "driver_specific": {} 00:05:40.557 }, 00:05:40.557 { 00:05:40.557 "name": "Passthru0", 00:05:40.557 "aliases": [ 00:05:40.557 "65ca3988-5c6d-50c6-a4d5-3b0a8f974572" 00:05:40.557 ], 00:05:40.557 "product_name": "passthru", 00:05:40.557 "block_size": 512, 00:05:40.557 "num_blocks": 16384, 00:05:40.557 "uuid": "65ca3988-5c6d-50c6-a4d5-3b0a8f974572", 00:05:40.557 "assigned_rate_limits": { 00:05:40.557 "rw_ios_per_sec": 0, 00:05:40.557 "rw_mbytes_per_sec": 0, 00:05:40.557 "r_mbytes_per_sec": 0, 00:05:40.557 "w_mbytes_per_sec": 0 00:05:40.557 }, 00:05:40.557 "claimed": false, 00:05:40.557 "zoned": false, 00:05:40.557 "supported_io_types": { 00:05:40.557 "read": true, 00:05:40.557 "write": true, 00:05:40.557 "unmap": true, 00:05:40.557 "write_zeroes": true, 00:05:40.557 "flush": true, 00:05:40.557 "reset": true, 00:05:40.557 "compare": false, 00:05:40.557 "compare_and_write": false, 00:05:40.557 "abort": true, 00:05:40.557 "nvme_admin": false, 00:05:40.557 "nvme_io": false 00:05:40.557 }, 00:05:40.557 "memory_domains": [ 00:05:40.557 { 00:05:40.557 "dma_device_id": "system", 00:05:40.557 "dma_device_type": 1 00:05:40.557 }, 00:05:40.557 { 00:05:40.557 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.557 "dma_device_type": 2 00:05:40.557 } 00:05:40.557 ], 00:05:40.557 "driver_specific": { 00:05:40.557 "passthru": { 00:05:40.557 "name": "Passthru0", 00:05:40.557 "base_bdev_name": "Malloc2" 00:05:40.557 } 00:05:40.557 } 00:05:40.557 } 00:05:40.557 ]' 00:05:40.557 21:06:34 -- rpc/rpc.sh@21 -- # jq length 00:05:40.557 21:06:34 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:40.557 21:06:34 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:40.557 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.557 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.557 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.557 21:06:34 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:40.557 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.557 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.557 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.557 21:06:34 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:40.557 21:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.557 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.557 21:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.557 21:06:34 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:40.557 21:06:34 -- rpc/rpc.sh@26 -- # jq length 00:05:40.815 21:06:34 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:40.815 00:05:40.815 real 0m0.269s 00:05:40.815 user 0m0.174s 00:05:40.815 sys 0m0.031s 00:05:40.815 21:06:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.815 21:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:40.815 ************************************ 00:05:40.815 END TEST rpc_daemon_integrity 00:05:40.815 ************************************ 00:05:40.815 21:06:34 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:40.815 21:06:34 -- rpc/rpc.sh@84 -- # killprocess 1152636 00:05:40.815 21:06:34 -- common/autotest_common.sh@936 -- # '[' -z 1152636 ']' 00:05:40.815 21:06:34 -- common/autotest_common.sh@940 -- # kill -0 1152636 00:05:40.815 21:06:34 -- common/autotest_common.sh@941 -- # uname 00:05:40.815 21:06:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:40.815 21:06:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1152636 00:05:40.815 21:06:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:40.815 21:06:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:40.815 21:06:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1152636' 00:05:40.815 killing process with pid 1152636 00:05:40.815 21:06:34 -- common/autotest_common.sh@955 -- # kill 1152636 00:05:40.815 21:06:34 -- common/autotest_common.sh@960 -- # wait 1152636 00:05:41.091 00:05:41.091 real 0m2.716s 00:05:41.091 user 0m3.491s 00:05:41.091 sys 0m0.797s 00:05:41.091 21:06:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.091 21:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:41.091 ************************************ 00:05:41.091 END TEST rpc 00:05:41.091 ************************************ 00:05:41.091 21:06:35 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.091 21:06:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.091 21:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.091 21:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:41.358 ************************************ 00:05:41.358 START TEST skip_rpc 00:05:41.358 ************************************ 00:05:41.358 21:06:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.358 * Looking for test storage... 00:05:41.358 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:41.358 21:06:35 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:41.358 21:06:35 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:41.358 21:06:35 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:05:41.358 21:06:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.359 21:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.359 21:06:35 -- common/autotest_common.sh@10 -- # set +x 00:05:41.359 ************************************ 00:05:41.359 START TEST skip_rpc 00:05:41.359 ************************************ 00:05:41.359 21:06:35 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:05:41.359 21:06:35 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=1153423 00:05:41.359 21:06:35 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:41.359 21:06:35 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:05:41.359 21:06:35 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:05:41.616 [2024-04-23 21:06:35.664482] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:41.616 [2024-04-23 21:06:35.664515] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1153423 ] 00:05:41.616 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.616 [2024-04-23 21:06:35.713606] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.616 [2024-04-23 21:06:35.777668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.880 21:06:40 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:05:46.880 21:06:40 -- common/autotest_common.sh@638 -- # local es=0 00:05:46.880 21:06:40 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:05:46.880 21:06:40 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:46.880 21:06:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:46.880 21:06:40 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:46.880 21:06:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:46.880 21:06:40 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:05:46.880 21:06:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:46.880 21:06:40 -- common/autotest_common.sh@10 -- # set +x 00:05:46.880 21:06:40 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:46.880 21:06:40 -- common/autotest_common.sh@641 -- # es=1 00:05:46.880 21:06:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:46.880 21:06:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:46.880 21:06:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:46.880 21:06:40 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:05:46.880 21:06:40 -- rpc/skip_rpc.sh@23 -- # killprocess 1153423 00:05:46.880 21:06:40 -- common/autotest_common.sh@936 -- # '[' -z 1153423 ']' 00:05:46.880 21:06:40 -- common/autotest_common.sh@940 -- # kill -0 1153423 00:05:46.880 21:06:40 -- common/autotest_common.sh@941 -- # uname 00:05:46.880 21:06:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:46.880 21:06:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1153423 00:05:46.880 21:06:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:46.880 21:06:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:46.880 21:06:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1153423' 00:05:46.880 killing process with pid 1153423 00:05:46.880 21:06:40 -- common/autotest_common.sh@955 -- # kill 1153423 00:05:46.880 21:06:40 -- common/autotest_common.sh@960 -- # wait 1153423 00:05:46.880 00:05:46.880 real 0m5.381s 00:05:46.880 user 0m5.163s 00:05:46.880 sys 0m0.243s 00:05:46.880 21:06:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:46.880 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:46.880 ************************************ 00:05:46.880 END TEST skip_rpc 00:05:46.880 ************************************ 00:05:46.880 21:06:41 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:05:46.880 21:06:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:46.880 21:06:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.880 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:47.139 ************************************ 00:05:47.139 START TEST skip_rpc_with_json 00:05:47.139 ************************************ 00:05:47.139 21:06:41 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:05:47.139 21:06:41 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:05:47.139 21:06:41 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=1154465 00:05:47.139 21:06:41 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:47.139 21:06:41 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:47.139 21:06:41 -- rpc/skip_rpc.sh@31 -- # waitforlisten 1154465 00:05:47.139 21:06:41 -- common/autotest_common.sh@817 -- # '[' -z 1154465 ']' 00:05:47.139 21:06:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.139 21:06:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:47.139 21:06:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.139 21:06:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:47.139 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:47.139 [2024-04-23 21:06:41.210843] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:47.139 [2024-04-23 21:06:41.210885] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154465 ] 00:05:47.139 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.139 [2024-04-23 21:06:41.263121] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.139 [2024-04-23 21:06:41.331367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.705 21:06:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:47.705 21:06:41 -- common/autotest_common.sh@850 -- # return 0 00:05:47.705 21:06:41 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:05:47.964 21:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.964 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:47.964 [2024-04-23 21:06:41.981185] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:05:47.964 request: 00:05:47.964 { 00:05:47.964 "trtype": "tcp", 00:05:47.964 "method": "nvmf_get_transports", 00:05:47.964 "req_id": 1 00:05:47.964 } 00:05:47.964 Got JSON-RPC error response 00:05:47.964 response: 00:05:47.964 { 00:05:47.964 "code": -19, 00:05:47.964 "message": "No such device" 00:05:47.964 } 00:05:47.964 21:06:41 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:47.964 21:06:41 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:05:47.964 21:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.964 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:47.964 [2024-04-23 21:06:41.993273] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:47.964 21:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:47.964 21:06:41 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:05:47.964 21:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.964 21:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:47.964 21:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:47.964 21:06:42 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:47.964 { 00:05:47.964 "subsystems": [ 00:05:47.964 { 00:05:47.964 "subsystem": "keyring", 00:05:47.964 "config": [] 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "subsystem": "iobuf", 00:05:47.964 "config": [ 00:05:47.964 { 00:05:47.964 "method": "iobuf_set_options", 00:05:47.964 "params": { 00:05:47.964 "small_pool_count": 8192, 00:05:47.964 "large_pool_count": 1024, 00:05:47.964 "small_bufsize": 8192, 00:05:47.964 "large_bufsize": 135168 00:05:47.964 } 00:05:47.964 } 00:05:47.964 ] 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "subsystem": "sock", 00:05:47.964 "config": [ 00:05:47.964 { 00:05:47.964 "method": "sock_impl_set_options", 00:05:47.964 "params": { 00:05:47.964 "impl_name": "posix", 00:05:47.964 "recv_buf_size": 2097152, 00:05:47.964 "send_buf_size": 2097152, 00:05:47.964 "enable_recv_pipe": true, 00:05:47.964 "enable_quickack": false, 00:05:47.964 "enable_placement_id": 0, 00:05:47.964 "enable_zerocopy_send_server": true, 00:05:47.964 "enable_zerocopy_send_client": false, 00:05:47.964 "zerocopy_threshold": 0, 00:05:47.964 "tls_version": 0, 00:05:47.964 "enable_ktls": false 00:05:47.964 } 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "method": "sock_impl_set_options", 00:05:47.964 "params": { 00:05:47.964 "impl_name": "ssl", 00:05:47.964 "recv_buf_size": 4096, 00:05:47.964 "send_buf_size": 4096, 00:05:47.964 "enable_recv_pipe": true, 00:05:47.964 "enable_quickack": false, 00:05:47.964 "enable_placement_id": 0, 00:05:47.964 "enable_zerocopy_send_server": true, 00:05:47.964 "enable_zerocopy_send_client": false, 00:05:47.964 "zerocopy_threshold": 0, 00:05:47.964 "tls_version": 0, 00:05:47.964 "enable_ktls": false 00:05:47.964 } 00:05:47.964 } 00:05:47.964 ] 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "subsystem": "vmd", 00:05:47.964 "config": [] 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "subsystem": "accel", 00:05:47.964 "config": [ 00:05:47.964 { 00:05:47.964 "method": "accel_set_options", 00:05:47.964 "params": { 00:05:47.964 "small_cache_size": 128, 00:05:47.964 "large_cache_size": 16, 00:05:47.964 "task_count": 2048, 00:05:47.964 "sequence_count": 2048, 00:05:47.964 "buf_count": 2048 00:05:47.964 } 00:05:47.964 } 00:05:47.964 ] 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "subsystem": "bdev", 00:05:47.964 "config": [ 00:05:47.964 { 00:05:47.964 "method": "bdev_set_options", 00:05:47.964 "params": { 00:05:47.964 "bdev_io_pool_size": 65535, 00:05:47.964 "bdev_io_cache_size": 256, 00:05:47.964 "bdev_auto_examine": true, 00:05:47.964 "iobuf_small_cache_size": 128, 00:05:47.964 "iobuf_large_cache_size": 16 00:05:47.964 } 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "method": "bdev_raid_set_options", 00:05:47.964 "params": { 00:05:47.964 "process_window_size_kb": 1024 00:05:47.964 } 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "method": "bdev_iscsi_set_options", 00:05:47.964 "params": { 00:05:47.964 "timeout_sec": 30 00:05:47.964 } 00:05:47.964 }, 00:05:47.964 { 00:05:47.964 "method": "bdev_nvme_set_options", 00:05:47.964 "params": { 00:05:47.964 "action_on_timeout": "none", 00:05:47.964 "timeout_us": 0, 00:05:47.964 "timeout_admin_us": 0, 00:05:47.964 "keep_alive_timeout_ms": 10000, 00:05:47.964 "arbitration_burst": 0, 00:05:47.964 "low_priority_weight": 0, 00:05:47.964 "medium_priority_weight": 0, 00:05:47.964 "high_priority_weight": 0, 00:05:47.964 "nvme_adminq_poll_period_us": 10000, 00:05:47.964 "nvme_ioq_poll_period_us": 0, 00:05:47.964 "io_queue_requests": 0, 00:05:47.964 "delay_cmd_submit": true, 00:05:47.964 "transport_retry_count": 4, 00:05:47.964 "bdev_retry_count": 3, 00:05:47.964 "transport_ack_timeout": 0, 00:05:47.965 "ctrlr_loss_timeout_sec": 0, 00:05:47.965 "reconnect_delay_sec": 0, 00:05:47.965 "fast_io_fail_timeout_sec": 0, 00:05:47.965 "disable_auto_failback": false, 00:05:47.965 "generate_uuids": false, 00:05:47.965 "transport_tos": 0, 00:05:47.965 "nvme_error_stat": false, 00:05:47.965 "rdma_srq_size": 0, 00:05:47.965 "io_path_stat": false, 00:05:47.965 "allow_accel_sequence": false, 00:05:47.965 "rdma_max_cq_size": 0, 00:05:47.965 "rdma_cm_event_timeout_ms": 0, 00:05:47.965 "dhchap_digests": [ 00:05:47.965 "sha256", 00:05:47.965 "sha384", 00:05:47.965 "sha512" 00:05:47.965 ], 00:05:47.965 "dhchap_dhgroups": [ 00:05:47.965 "null", 00:05:47.965 "ffdhe2048", 00:05:47.965 "ffdhe3072", 00:05:47.965 "ffdhe4096", 00:05:47.965 "ffdhe6144", 00:05:47.965 "ffdhe8192" 00:05:47.965 ] 00:05:47.965 } 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "method": "bdev_nvme_set_hotplug", 00:05:47.965 "params": { 00:05:47.965 "period_us": 100000, 00:05:47.965 "enable": false 00:05:47.965 } 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "method": "bdev_wait_for_examine" 00:05:47.965 } 00:05:47.965 ] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "scsi", 00:05:47.965 "config": null 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "scheduler", 00:05:47.965 "config": [ 00:05:47.965 { 00:05:47.965 "method": "framework_set_scheduler", 00:05:47.965 "params": { 00:05:47.965 "name": "static" 00:05:47.965 } 00:05:47.965 } 00:05:47.965 ] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "vhost_scsi", 00:05:47.965 "config": [] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "vhost_blk", 00:05:47.965 "config": [] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "ublk", 00:05:47.965 "config": [] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "nbd", 00:05:47.965 "config": [] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "nvmf", 00:05:47.965 "config": [ 00:05:47.965 { 00:05:47.965 "method": "nvmf_set_config", 00:05:47.965 "params": { 00:05:47.965 "discovery_filter": "match_any", 00:05:47.965 "admin_cmd_passthru": { 00:05:47.965 "identify_ctrlr": false 00:05:47.965 } 00:05:47.965 } 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "method": "nvmf_set_max_subsystems", 00:05:47.965 "params": { 00:05:47.965 "max_subsystems": 1024 00:05:47.965 } 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "method": "nvmf_set_crdt", 00:05:47.965 "params": { 00:05:47.965 "crdt1": 0, 00:05:47.965 "crdt2": 0, 00:05:47.965 "crdt3": 0 00:05:47.965 } 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "method": "nvmf_create_transport", 00:05:47.965 "params": { 00:05:47.965 "trtype": "TCP", 00:05:47.965 "max_queue_depth": 128, 00:05:47.965 "max_io_qpairs_per_ctrlr": 127, 00:05:47.965 "in_capsule_data_size": 4096, 00:05:47.965 "max_io_size": 131072, 00:05:47.965 "io_unit_size": 131072, 00:05:47.965 "max_aq_depth": 128, 00:05:47.965 "num_shared_buffers": 511, 00:05:47.965 "buf_cache_size": 4294967295, 00:05:47.965 "dif_insert_or_strip": false, 00:05:47.965 "zcopy": false, 00:05:47.965 "c2h_success": true, 00:05:47.965 "sock_priority": 0, 00:05:47.965 "abort_timeout_sec": 1, 00:05:47.965 "ack_timeout": 0, 00:05:47.965 "data_wr_pool_size": 0 00:05:47.965 } 00:05:47.965 } 00:05:47.965 ] 00:05:47.965 }, 00:05:47.965 { 00:05:47.965 "subsystem": "iscsi", 00:05:47.965 "config": [ 00:05:47.965 { 00:05:47.965 "method": "iscsi_set_options", 00:05:47.965 "params": { 00:05:47.965 "node_base": "iqn.2016-06.io.spdk", 00:05:47.965 "max_sessions": 128, 00:05:47.965 "max_connections_per_session": 2, 00:05:47.965 "max_queue_depth": 64, 00:05:47.965 "default_time2wait": 2, 00:05:47.965 "default_time2retain": 20, 00:05:47.965 "first_burst_length": 8192, 00:05:47.965 "immediate_data": true, 00:05:47.965 "allow_duplicated_isid": false, 00:05:47.965 "error_recovery_level": 0, 00:05:47.965 "nop_timeout": 60, 00:05:47.965 "nop_in_interval": 30, 00:05:47.965 "disable_chap": false, 00:05:47.965 "require_chap": false, 00:05:47.965 "mutual_chap": false, 00:05:47.965 "chap_group": 0, 00:05:47.965 "max_large_datain_per_connection": 64, 00:05:47.965 "max_r2t_per_connection": 4, 00:05:47.965 "pdu_pool_size": 36864, 00:05:47.965 "immediate_data_pool_size": 16384, 00:05:47.965 "data_out_pool_size": 2048 00:05:47.965 } 00:05:47.965 } 00:05:47.965 ] 00:05:47.965 } 00:05:47.965 ] 00:05:47.965 } 00:05:47.965 21:06:42 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:05:47.965 21:06:42 -- rpc/skip_rpc.sh@40 -- # killprocess 1154465 00:05:47.965 21:06:42 -- common/autotest_common.sh@936 -- # '[' -z 1154465 ']' 00:05:47.965 21:06:42 -- common/autotest_common.sh@940 -- # kill -0 1154465 00:05:47.965 21:06:42 -- common/autotest_common.sh@941 -- # uname 00:05:47.965 21:06:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.965 21:06:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1154465 00:05:47.965 21:06:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.965 21:06:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.965 21:06:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1154465' 00:05:47.965 killing process with pid 1154465 00:05:47.965 21:06:42 -- common/autotest_common.sh@955 -- # kill 1154465 00:05:47.965 21:06:42 -- common/autotest_common.sh@960 -- # wait 1154465 00:05:48.531 21:06:42 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=1154737 00:05:48.531 21:06:42 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:48.531 21:06:42 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:05:53.806 21:06:47 -- rpc/skip_rpc.sh@50 -- # killprocess 1154737 00:05:53.806 21:06:47 -- common/autotest_common.sh@936 -- # '[' -z 1154737 ']' 00:05:53.806 21:06:47 -- common/autotest_common.sh@940 -- # kill -0 1154737 00:05:53.806 21:06:47 -- common/autotest_common.sh@941 -- # uname 00:05:53.806 21:06:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:53.806 21:06:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1154737 00:05:53.806 21:06:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:53.806 21:06:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:53.806 21:06:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1154737' 00:05:53.806 killing process with pid 1154737 00:05:53.806 21:06:47 -- common/autotest_common.sh@955 -- # kill 1154737 00:05:53.806 21:06:47 -- common/autotest_common.sh@960 -- # wait 1154737 00:05:53.806 21:06:47 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:53.806 21:06:47 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:53.806 00:05:53.806 real 0m6.733s 00:05:53.806 user 0m6.564s 00:05:53.806 sys 0m0.559s 00:05:53.806 21:06:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:53.806 21:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:53.806 ************************************ 00:05:53.806 END TEST skip_rpc_with_json 00:05:53.806 ************************************ 00:05:53.806 21:06:47 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:05:53.806 21:06:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:53.806 21:06:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.806 21:06:47 -- common/autotest_common.sh@10 -- # set +x 00:05:53.806 ************************************ 00:05:53.806 START TEST skip_rpc_with_delay 00:05:53.806 ************************************ 00:05:53.806 21:06:48 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:05:53.806 21:06:48 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:53.806 21:06:48 -- common/autotest_common.sh@638 -- # local es=0 00:05:53.806 21:06:48 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:53.806 21:06:48 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:53.806 21:06:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:53.806 21:06:48 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:53.806 21:06:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:53.806 21:06:48 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:53.806 21:06:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:53.806 21:06:48 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:53.806 21:06:48 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:53.806 21:06:48 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.064 [2024-04-23 21:06:48.087241] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:05:54.064 [2024-04-23 21:06:48.087311] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:05:54.064 21:06:48 -- common/autotest_common.sh@641 -- # es=1 00:05:54.064 21:06:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:54.064 21:06:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:54.064 21:06:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:54.064 00:05:54.064 real 0m0.063s 00:05:54.064 user 0m0.038s 00:05:54.064 sys 0m0.024s 00:05:54.064 21:06:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.064 21:06:48 -- common/autotest_common.sh@10 -- # set +x 00:05:54.064 ************************************ 00:05:54.064 END TEST skip_rpc_with_delay 00:05:54.064 ************************************ 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@77 -- # uname 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:05:54.064 21:06:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.064 21:06:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.064 21:06:48 -- common/autotest_common.sh@10 -- # set +x 00:05:54.064 ************************************ 00:05:54.064 START TEST exit_on_failed_rpc_init 00:05:54.064 ************************************ 00:05:54.064 21:06:48 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=1155856 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@63 -- # waitforlisten 1155856 00:05:54.064 21:06:48 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:54.064 21:06:48 -- common/autotest_common.sh@817 -- # '[' -z 1155856 ']' 00:05:54.064 21:06:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.064 21:06:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:54.065 21:06:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.065 21:06:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:54.065 21:06:48 -- common/autotest_common.sh@10 -- # set +x 00:05:54.065 [2024-04-23 21:06:48.308135] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:54.065 [2024-04-23 21:06:48.308177] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1155856 ] 00:05:54.065 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.323 [2024-04-23 21:06:48.359270] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.323 [2024-04-23 21:06:48.433860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.889 21:06:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:54.889 21:06:49 -- common/autotest_common.sh@850 -- # return 0 00:05:54.889 21:06:49 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:54.889 21:06:49 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.889 21:06:49 -- common/autotest_common.sh@638 -- # local es=0 00:05:54.889 21:06:49 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.889 21:06:49 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.889 21:06:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.889 21:06:49 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.889 21:06:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.889 21:06:49 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.889 21:06:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.889 21:06:49 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.889 21:06:49 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:54.889 21:06:49 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:54.889 [2024-04-23 21:06:49.132313] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:54.889 [2024-04-23 21:06:49.132357] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156114 ] 00:05:54.889 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.147 [2024-04-23 21:06:49.181805] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.147 [2024-04-23 21:06:49.246648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.148 [2024-04-23 21:06:49.246725] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:05:55.148 [2024-04-23 21:06:49.246734] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:05:55.148 [2024-04-23 21:06:49.246739] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:55.148 21:06:49 -- common/autotest_common.sh@641 -- # es=234 00:05:55.148 21:06:49 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:55.148 21:06:49 -- common/autotest_common.sh@650 -- # es=106 00:05:55.148 21:06:49 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:55.148 21:06:49 -- common/autotest_common.sh@658 -- # es=1 00:05:55.148 21:06:49 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:55.148 21:06:49 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:05:55.148 21:06:49 -- rpc/skip_rpc.sh@70 -- # killprocess 1155856 00:05:55.148 21:06:49 -- common/autotest_common.sh@936 -- # '[' -z 1155856 ']' 00:05:55.148 21:06:49 -- common/autotest_common.sh@940 -- # kill -0 1155856 00:05:55.148 21:06:49 -- common/autotest_common.sh@941 -- # uname 00:05:55.148 21:06:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.148 21:06:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1155856 00:05:55.148 21:06:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.148 21:06:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.148 21:06:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1155856' 00:05:55.148 killing process with pid 1155856 00:05:55.148 21:06:49 -- common/autotest_common.sh@955 -- # kill 1155856 00:05:55.148 21:06:49 -- common/autotest_common.sh@960 -- # wait 1155856 00:05:55.714 00:05:55.714 real 0m1.436s 00:05:55.714 user 0m1.656s 00:05:55.714 sys 0m0.367s 00:05:55.714 21:06:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.714 21:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:55.714 ************************************ 00:05:55.714 END TEST exit_on_failed_rpc_init 00:05:55.714 ************************************ 00:05:55.714 21:06:49 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:55.714 00:05:55.714 real 0m14.317s 00:05:55.714 user 0m13.695s 00:05:55.714 sys 0m1.582s 00:05:55.714 21:06:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.714 21:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:55.714 ************************************ 00:05:55.714 END TEST skip_rpc 00:05:55.714 ************************************ 00:05:55.714 21:06:49 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:55.714 21:06:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.714 21:06:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.714 21:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:55.714 ************************************ 00:05:55.714 START TEST rpc_client 00:05:55.714 ************************************ 00:05:55.714 21:06:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:55.714 * Looking for test storage... 00:05:55.714 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:05:55.714 21:06:49 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:55.972 OK 00:05:55.972 21:06:49 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:55.972 00:05:55.972 real 0m0.110s 00:05:55.972 user 0m0.048s 00:05:55.972 sys 0m0.067s 00:05:55.972 21:06:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:55.972 21:06:49 -- common/autotest_common.sh@10 -- # set +x 00:05:55.972 ************************************ 00:05:55.972 END TEST rpc_client 00:05:55.972 ************************************ 00:05:55.972 21:06:50 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:55.972 21:06:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.972 21:06:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.972 21:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:55.972 ************************************ 00:05:55.972 START TEST json_config 00:05:55.972 ************************************ 00:05:55.972 21:06:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:55.972 21:06:50 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:05:55.972 21:06:50 -- nvmf/common.sh@7 -- # uname -s 00:05:55.972 21:06:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:55.972 21:06:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:55.972 21:06:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:55.972 21:06:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:55.972 21:06:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:55.972 21:06:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:55.972 21:06:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:55.972 21:06:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:55.972 21:06:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:55.972 21:06:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:55.972 21:06:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:05:55.972 21:06:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:05:55.972 21:06:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:55.972 21:06:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:55.972 21:06:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:55.972 21:06:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:55.972 21:06:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:05:56.231 21:06:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:56.231 21:06:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:56.231 21:06:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:56.231 21:06:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:56.231 21:06:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:56.231 21:06:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:56.231 21:06:50 -- paths/export.sh@5 -- # export PATH 00:05:56.231 21:06:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:56.231 21:06:50 -- nvmf/common.sh@47 -- # : 0 00:05:56.232 21:06:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:56.232 21:06:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:56.232 21:06:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:56.232 21:06:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:56.232 21:06:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:56.232 21:06:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:56.232 21:06:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:56.232 21:06:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:56.232 21:06:50 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:05:56.232 21:06:50 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:05:56.232 21:06:50 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:05:56.232 21:06:50 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:05:56.232 21:06:50 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:56.232 21:06:50 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:05:56.232 21:06:50 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:05:56.232 21:06:50 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:56.232 21:06:50 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:05:56.232 21:06:50 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:56.232 21:06:50 -- json_config/json_config.sh@33 -- # declare -A app_params 00:05:56.232 21:06:50 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:05:56.232 21:06:50 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:05:56.232 21:06:50 -- json_config/json_config.sh@40 -- # last_event_id=0 00:05:56.232 21:06:50 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:56.232 21:06:50 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:05:56.232 INFO: JSON configuration test init 00:05:56.232 21:06:50 -- json_config/json_config.sh@357 -- # json_config_test_init 00:05:56.232 21:06:50 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:05:56.232 21:06:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:56.232 21:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:56.232 21:06:50 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:05:56.232 21:06:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:56.232 21:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:56.232 21:06:50 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:05:56.232 21:06:50 -- json_config/common.sh@9 -- # local app=target 00:05:56.232 21:06:50 -- json_config/common.sh@10 -- # shift 00:05:56.232 21:06:50 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:56.232 21:06:50 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:56.232 21:06:50 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:56.232 21:06:50 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:56.232 21:06:50 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:56.232 21:06:50 -- json_config/common.sh@22 -- # app_pid["$app"]=1156503 00:05:56.232 21:06:50 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:56.232 Waiting for target to run... 00:05:56.232 21:06:50 -- json_config/common.sh@25 -- # waitforlisten 1156503 /var/tmp/spdk_tgt.sock 00:05:56.232 21:06:50 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:56.232 21:06:50 -- common/autotest_common.sh@817 -- # '[' -z 1156503 ']' 00:05:56.232 21:06:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:56.232 21:06:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:56.232 21:06:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:56.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:56.232 21:06:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:56.232 21:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:56.232 [2024-04-23 21:06:50.317315] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:05:56.232 [2024-04-23 21:06:50.317359] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156503 ] 00:05:56.232 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.490 [2024-04-23 21:06:50.724708] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.749 [2024-04-23 21:06:50.811119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.006 21:06:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:57.006 21:06:51 -- common/autotest_common.sh@850 -- # return 0 00:05:57.006 21:06:51 -- json_config/common.sh@26 -- # echo '' 00:05:57.006 00:05:57.006 21:06:51 -- json_config/json_config.sh@269 -- # create_accel_config 00:05:57.006 21:06:51 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:05:57.006 21:06:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:57.006 21:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:57.006 21:06:51 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:05:57.006 21:06:51 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:05:57.007 21:06:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:57.007 21:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:57.007 21:06:51 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:57.007 21:06:51 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:05:57.007 21:06:51 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:00.289 21:06:54 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:06:00.289 21:06:54 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:00.289 21:06:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:00.289 21:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:00.289 21:06:54 -- json_config/json_config.sh@45 -- # local ret=0 00:06:00.289 21:06:54 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:00.289 21:06:54 -- json_config/json_config.sh@46 -- # local enabled_types 00:06:00.289 21:06:54 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:06:00.289 21:06:54 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:06:00.289 21:06:54 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:00.289 21:06:54 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:00.289 21:06:54 -- json_config/json_config.sh@48 -- # local get_types 00:06:00.289 21:06:54 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:06:00.289 21:06:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:00.289 21:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:00.289 21:06:54 -- json_config/json_config.sh@55 -- # return 0 00:06:00.289 21:06:54 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:06:00.289 21:06:54 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:06:00.289 21:06:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:00.289 21:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:00.289 21:06:54 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:00.289 21:06:54 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:06:00.289 21:06:54 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:06:00.289 21:06:54 -- json_config/json_config.sh@234 -- # nvmftestinit 00:06:00.289 21:06:54 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:00.289 21:06:54 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:00.289 21:06:54 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:00.289 21:06:54 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:00.289 21:06:54 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:00.289 21:06:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:00.289 21:06:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:06:00.289 21:06:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:00.289 21:06:54 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:06:00.289 21:06:54 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:00.289 21:06:54 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:00.289 21:06:54 -- common/autotest_common.sh@10 -- # set +x 00:06:05.555 21:06:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:05.555 21:06:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:05.555 21:06:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:05.555 21:06:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:05.555 21:06:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:05.555 21:06:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:05.555 21:06:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:05.555 21:06:59 -- nvmf/common.sh@295 -- # net_devs=() 00:06:05.555 21:06:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:05.555 21:06:59 -- nvmf/common.sh@296 -- # e810=() 00:06:05.555 21:06:59 -- nvmf/common.sh@296 -- # local -ga e810 00:06:05.555 21:06:59 -- nvmf/common.sh@297 -- # x722=() 00:06:05.555 21:06:59 -- nvmf/common.sh@297 -- # local -ga x722 00:06:05.555 21:06:59 -- nvmf/common.sh@298 -- # mlx=() 00:06:05.555 21:06:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:05.555 21:06:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:05.555 21:06:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:05.555 21:06:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:05.555 21:06:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:06:05.555 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:06:05.555 21:06:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:05.555 21:06:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:05.555 21:06:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:06:05.555 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:06:05.555 21:06:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:05.555 21:06:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:05.555 21:06:59 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:05.555 21:06:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:05.555 21:06:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:05.555 21:06:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:05.555 21:06:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:06:05.555 Found net devices under 0000:18:00.0: mlx_0_0 00:06:05.555 21:06:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:05.555 21:06:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:05.555 21:06:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:05.555 21:06:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:05.555 21:06:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:06:05.555 Found net devices under 0000:18:00.1: mlx_0_1 00:06:05.555 21:06:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:05.555 21:06:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:05.555 21:06:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:05.555 21:06:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:05.555 21:06:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:05.555 21:06:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:05.555 21:06:59 -- nvmf/common.sh@58 -- # uname 00:06:05.555 21:06:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:05.555 21:06:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:05.555 21:06:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:05.555 21:06:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:05.555 21:06:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:05.555 21:06:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:05.555 21:06:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:05.555 21:06:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:05.555 21:06:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:05.555 21:06:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:05.555 21:06:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:05.555 21:06:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:05.555 21:06:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:05.555 21:06:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:05.555 21:06:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:05.814 21:06:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:05.814 21:06:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@105 -- # continue 2 00:06:05.814 21:06:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@105 -- # continue 2 00:06:05.814 21:06:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:05.814 21:06:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:05.814 21:06:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:05.814 21:06:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:05.814 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:05.814 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:06:05.814 altname enp24s0f0np0 00:06:05.814 altname ens785f0np0 00:06:05.814 inet 192.168.100.8/24 scope global mlx_0_0 00:06:05.814 valid_lft forever preferred_lft forever 00:06:05.814 21:06:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:05.814 21:06:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:05.814 21:06:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:05.814 21:06:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:05.814 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:05.814 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:06:05.814 altname enp24s0f1np1 00:06:05.814 altname ens785f1np1 00:06:05.814 inet 192.168.100.9/24 scope global mlx_0_1 00:06:05.814 valid_lft forever preferred_lft forever 00:06:05.814 21:06:59 -- nvmf/common.sh@411 -- # return 0 00:06:05.814 21:06:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:05.814 21:06:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:05.814 21:06:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:05.814 21:06:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:05.814 21:06:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:05.814 21:06:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:05.814 21:06:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:05.814 21:06:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:05.814 21:06:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:05.814 21:06:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@105 -- # continue 2 00:06:05.814 21:06:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:05.814 21:06:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:05.814 21:06:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@105 -- # continue 2 00:06:05.814 21:06:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:05.814 21:06:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:05.814 21:06:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:05.814 21:06:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:05.814 21:06:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:05.814 21:06:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:05.814 192.168.100.9' 00:06:05.814 21:06:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:05.814 192.168.100.9' 00:06:05.814 21:06:59 -- nvmf/common.sh@446 -- # head -n 1 00:06:05.814 21:06:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:05.814 21:06:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:05.814 192.168.100.9' 00:06:05.814 21:06:59 -- nvmf/common.sh@447 -- # tail -n +2 00:06:05.814 21:06:59 -- nvmf/common.sh@447 -- # head -n 1 00:06:05.814 21:06:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:05.815 21:06:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:05.815 21:06:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:05.815 21:06:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:05.815 21:06:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:05.815 21:06:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:05.815 21:06:59 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:06:05.815 21:06:59 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:05.815 21:06:59 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:06.073 MallocForNvmf0 00:06:06.073 21:07:00 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:06.073 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:06.073 MallocForNvmf1 00:06:06.073 21:07:00 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:06:06.073 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:06:06.331 [2024-04-23 21:07:00.409081] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:06.331 [2024-04-23 21:07:00.433065] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1cff8e0/0x1d2c6c0) succeed. 00:06:06.331 [2024-04-23 21:07:00.443285] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d01ad0/0x1d8c6c0) succeed. 00:06:06.331 21:07:00 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:06.331 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:06.588 21:07:00 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:06.589 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:06.589 21:07:00 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:06.589 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:06.846 21:07:00 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:06.846 21:07:00 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:06.846 [2024-04-23 21:07:01.062967] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:06.846 21:07:01 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:06:06.846 21:07:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:06.846 21:07:01 -- common/autotest_common.sh@10 -- # set +x 00:06:06.846 21:07:01 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:06:06.846 21:07:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:06.846 21:07:01 -- common/autotest_common.sh@10 -- # set +x 00:06:07.104 21:07:01 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:06:07.104 21:07:01 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:07.104 21:07:01 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:07.104 MallocBdevForConfigChangeCheck 00:06:07.104 21:07:01 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:06:07.104 21:07:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:07.104 21:07:01 -- common/autotest_common.sh@10 -- # set +x 00:06:07.104 21:07:01 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:06:07.104 21:07:01 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:07.364 21:07:01 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:06:07.364 INFO: shutting down applications... 00:06:07.364 21:07:01 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:06:07.364 21:07:01 -- json_config/json_config.sh@368 -- # json_config_clear target 00:06:07.364 21:07:01 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:06:07.364 21:07:01 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:11.598 Calling clear_iscsi_subsystem 00:06:11.598 Calling clear_nvmf_subsystem 00:06:11.598 Calling clear_nbd_subsystem 00:06:11.598 Calling clear_ublk_subsystem 00:06:11.598 Calling clear_vhost_blk_subsystem 00:06:11.598 Calling clear_vhost_scsi_subsystem 00:06:11.598 Calling clear_bdev_subsystem 00:06:11.598 21:07:05 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:06:11.598 21:07:05 -- json_config/json_config.sh@343 -- # count=100 00:06:11.598 21:07:05 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:06:11.598 21:07:05 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:11.598 21:07:05 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:11.598 21:07:05 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:11.598 21:07:05 -- json_config/json_config.sh@345 -- # break 00:06:11.598 21:07:05 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:06:11.598 21:07:05 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:06:11.598 21:07:05 -- json_config/common.sh@31 -- # local app=target 00:06:11.598 21:07:05 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:11.598 21:07:05 -- json_config/common.sh@35 -- # [[ -n 1156503 ]] 00:06:11.598 21:07:05 -- json_config/common.sh@38 -- # kill -SIGINT 1156503 00:06:11.598 21:07:05 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:11.598 21:07:05 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:11.598 21:07:05 -- json_config/common.sh@41 -- # kill -0 1156503 00:06:11.598 21:07:05 -- json_config/common.sh@45 -- # sleep 0.5 00:06:11.598 [2024-04-23 21:07:05.849456] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:12.166 21:07:06 -- json_config/common.sh@40 -- # (( i++ )) 00:06:12.166 21:07:06 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:12.166 21:07:06 -- json_config/common.sh@41 -- # kill -0 1156503 00:06:12.166 21:07:06 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:12.166 21:07:06 -- json_config/common.sh@43 -- # break 00:06:12.166 21:07:06 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:12.166 21:07:06 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:12.166 SPDK target shutdown done 00:06:12.166 21:07:06 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:06:12.166 INFO: relaunching applications... 00:06:12.166 21:07:06 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:12.166 21:07:06 -- json_config/common.sh@9 -- # local app=target 00:06:12.166 21:07:06 -- json_config/common.sh@10 -- # shift 00:06:12.166 21:07:06 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:12.166 21:07:06 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:12.166 21:07:06 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:12.166 21:07:06 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:12.166 21:07:06 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:12.166 21:07:06 -- json_config/common.sh@22 -- # app_pid["$app"]=1161657 00:06:12.166 21:07:06 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:12.166 Waiting for target to run... 00:06:12.166 21:07:06 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:12.166 21:07:06 -- json_config/common.sh@25 -- # waitforlisten 1161657 /var/tmp/spdk_tgt.sock 00:06:12.166 21:07:06 -- common/autotest_common.sh@817 -- # '[' -z 1161657 ']' 00:06:12.166 21:07:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:12.166 21:07:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:12.166 21:07:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:12.166 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:12.166 21:07:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:12.166 21:07:06 -- common/autotest_common.sh@10 -- # set +x 00:06:12.166 [2024-04-23 21:07:06.301693] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:12.166 [2024-04-23 21:07:06.301740] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161657 ] 00:06:12.166 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.733 [2024-04-23 21:07:06.702031] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.733 [2024-04-23 21:07:06.786808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.017 [2024-04-23 21:07:09.804554] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bf3690/0x1c1fb40) succeed. 00:06:16.017 [2024-04-23 21:07:09.814460] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bf5880/0x1c7fb40) succeed. 00:06:16.017 [2024-04-23 21:07:09.862678] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:16.275 21:07:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:16.275 21:07:10 -- common/autotest_common.sh@850 -- # return 0 00:06:16.275 21:07:10 -- json_config/common.sh@26 -- # echo '' 00:06:16.275 00:06:16.275 21:07:10 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:06:16.275 21:07:10 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:16.275 INFO: Checking if target configuration is the same... 00:06:16.275 21:07:10 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:16.275 21:07:10 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:06:16.275 21:07:10 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:16.275 + '[' 2 -ne 2 ']' 00:06:16.275 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:16.275 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:06:16.275 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:16.275 +++ basename /dev/fd/62 00:06:16.275 ++ mktemp /tmp/62.XXX 00:06:16.275 + tmp_file_1=/tmp/62.bwh 00:06:16.275 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:16.275 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:16.275 + tmp_file_2=/tmp/spdk_tgt_config.json.4RU 00:06:16.275 + ret=0 00:06:16.275 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:16.532 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:16.532 + diff -u /tmp/62.bwh /tmp/spdk_tgt_config.json.4RU 00:06:16.532 + echo 'INFO: JSON config files are the same' 00:06:16.532 INFO: JSON config files are the same 00:06:16.532 + rm /tmp/62.bwh /tmp/spdk_tgt_config.json.4RU 00:06:16.532 + exit 0 00:06:16.532 21:07:10 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:06:16.532 21:07:10 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:16.532 INFO: changing configuration and checking if this can be detected... 00:06:16.532 21:07:10 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:16.532 21:07:10 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:16.790 21:07:10 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:06:16.790 21:07:10 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:16.790 21:07:10 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:16.790 + '[' 2 -ne 2 ']' 00:06:16.790 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:16.790 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:06:16.790 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:16.790 +++ basename /dev/fd/62 00:06:16.790 ++ mktemp /tmp/62.XXX 00:06:16.790 + tmp_file_1=/tmp/62.nqC 00:06:16.790 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:16.790 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:16.790 + tmp_file_2=/tmp/spdk_tgt_config.json.l2t 00:06:16.790 + ret=0 00:06:16.790 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:17.047 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:17.047 + diff -u /tmp/62.nqC /tmp/spdk_tgt_config.json.l2t 00:06:17.047 + ret=1 00:06:17.047 + echo '=== Start of file: /tmp/62.nqC ===' 00:06:17.047 + cat /tmp/62.nqC 00:06:17.047 + echo '=== End of file: /tmp/62.nqC ===' 00:06:17.047 + echo '' 00:06:17.047 + echo '=== Start of file: /tmp/spdk_tgt_config.json.l2t ===' 00:06:17.047 + cat /tmp/spdk_tgt_config.json.l2t 00:06:17.047 + echo '=== End of file: /tmp/spdk_tgt_config.json.l2t ===' 00:06:17.047 + echo '' 00:06:17.047 + rm /tmp/62.nqC /tmp/spdk_tgt_config.json.l2t 00:06:17.047 + exit 1 00:06:17.047 21:07:11 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:06:17.047 INFO: configuration change detected. 00:06:17.047 21:07:11 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:06:17.047 21:07:11 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:06:17.047 21:07:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:17.047 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:06:17.047 21:07:11 -- json_config/json_config.sh@307 -- # local ret=0 00:06:17.047 21:07:11 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:06:17.047 21:07:11 -- json_config/json_config.sh@317 -- # [[ -n 1161657 ]] 00:06:17.047 21:07:11 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:06:17.047 21:07:11 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:06:17.047 21:07:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:17.047 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:06:17.047 21:07:11 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:06:17.047 21:07:11 -- json_config/json_config.sh@193 -- # uname -s 00:06:17.047 21:07:11 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:06:17.047 21:07:11 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:06:17.047 21:07:11 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:06:17.047 21:07:11 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:06:17.047 21:07:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:17.047 21:07:11 -- common/autotest_common.sh@10 -- # set +x 00:06:17.047 21:07:11 -- json_config/json_config.sh@323 -- # killprocess 1161657 00:06:17.047 21:07:11 -- common/autotest_common.sh@936 -- # '[' -z 1161657 ']' 00:06:17.047 21:07:11 -- common/autotest_common.sh@940 -- # kill -0 1161657 00:06:17.047 21:07:11 -- common/autotest_common.sh@941 -- # uname 00:06:17.047 21:07:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:17.047 21:07:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1161657 00:06:17.305 21:07:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:17.305 21:07:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:17.305 21:07:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1161657' 00:06:17.305 killing process with pid 1161657 00:06:17.305 21:07:11 -- common/autotest_common.sh@955 -- # kill 1161657 00:06:17.305 21:07:11 -- common/autotest_common.sh@960 -- # wait 1161657 00:06:17.305 [2024-04-23 21:07:11.435105] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:21.487 21:07:15 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:21.487 21:07:15 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:06:21.487 21:07:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:21.487 21:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:21.487 21:07:15 -- json_config/json_config.sh@328 -- # return 0 00:06:21.487 21:07:15 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:06:21.487 INFO: Success 00:06:21.487 21:07:15 -- json_config/json_config.sh@1 -- # nvmftestfini 00:06:21.487 21:07:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:21.487 21:07:15 -- nvmf/common.sh@117 -- # sync 00:06:21.487 21:07:15 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:06:21.487 21:07:15 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:06:21.487 21:07:15 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:06:21.487 21:07:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:21.487 21:07:15 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:06:21.487 00:06:21.487 real 0m25.072s 00:06:21.487 user 0m26.956s 00:06:21.487 sys 0m6.130s 00:06:21.487 21:07:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.487 21:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:21.487 ************************************ 00:06:21.487 END TEST json_config 00:06:21.487 ************************************ 00:06:21.487 21:07:15 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:21.487 21:07:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.487 21:07:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.487 21:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:21.487 ************************************ 00:06:21.487 START TEST json_config_extra_key 00:06:21.487 ************************************ 00:06:21.487 21:07:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:21.487 21:07:15 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:21.487 21:07:15 -- nvmf/common.sh@7 -- # uname -s 00:06:21.487 21:07:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:21.487 21:07:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:21.487 21:07:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:21.487 21:07:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:21.487 21:07:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:21.487 21:07:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:21.487 21:07:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:21.487 21:07:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:21.487 21:07:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:21.487 21:07:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:21.487 21:07:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:06:21.487 21:07:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:06:21.487 21:07:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:21.487 21:07:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:21.487 21:07:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:21.487 21:07:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:21.487 21:07:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:21.487 21:07:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:21.487 21:07:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:21.487 21:07:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:21.488 21:07:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.488 21:07:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.488 21:07:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.488 21:07:15 -- paths/export.sh@5 -- # export PATH 00:06:21.488 21:07:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:21.488 21:07:15 -- nvmf/common.sh@47 -- # : 0 00:06:21.488 21:07:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:21.488 21:07:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:21.488 21:07:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:21.488 21:07:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:21.488 21:07:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:21.488 21:07:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:21.488 21:07:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:21.488 21:07:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:06:21.488 INFO: launching applications... 00:06:21.488 21:07:15 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:06:21.488 21:07:15 -- json_config/common.sh@9 -- # local app=target 00:06:21.488 21:07:15 -- json_config/common.sh@10 -- # shift 00:06:21.488 21:07:15 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:21.488 21:07:15 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:21.488 21:07:15 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:21.488 21:07:15 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:21.488 21:07:15 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:21.488 21:07:15 -- json_config/common.sh@22 -- # app_pid["$app"]=1163555 00:06:21.488 21:07:15 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:21.488 Waiting for target to run... 00:06:21.488 21:07:15 -- json_config/common.sh@25 -- # waitforlisten 1163555 /var/tmp/spdk_tgt.sock 00:06:21.488 21:07:15 -- common/autotest_common.sh@817 -- # '[' -z 1163555 ']' 00:06:21.488 21:07:15 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:06:21.488 21:07:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:21.488 21:07:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:21.488 21:07:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:21.488 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:21.488 21:07:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:21.488 21:07:15 -- common/autotest_common.sh@10 -- # set +x 00:06:21.488 [2024-04-23 21:07:15.548056] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:21.488 [2024-04-23 21:07:15.548110] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163555 ] 00:06:21.488 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.746 [2024-04-23 21:07:15.816343] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.746 [2024-04-23 21:07:15.874222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.312 21:07:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:22.312 21:07:16 -- common/autotest_common.sh@850 -- # return 0 00:06:22.312 21:07:16 -- json_config/common.sh@26 -- # echo '' 00:06:22.312 00:06:22.312 21:07:16 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:06:22.312 INFO: shutting down applications... 00:06:22.312 21:07:16 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:06:22.312 21:07:16 -- json_config/common.sh@31 -- # local app=target 00:06:22.312 21:07:16 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:22.312 21:07:16 -- json_config/common.sh@35 -- # [[ -n 1163555 ]] 00:06:22.312 21:07:16 -- json_config/common.sh@38 -- # kill -SIGINT 1163555 00:06:22.312 21:07:16 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:22.312 21:07:16 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:22.312 21:07:16 -- json_config/common.sh@41 -- # kill -0 1163555 00:06:22.312 21:07:16 -- json_config/common.sh@45 -- # sleep 0.5 00:06:22.570 21:07:16 -- json_config/common.sh@40 -- # (( i++ )) 00:06:22.570 21:07:16 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:22.570 21:07:16 -- json_config/common.sh@41 -- # kill -0 1163555 00:06:22.570 21:07:16 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:22.570 21:07:16 -- json_config/common.sh@43 -- # break 00:06:22.570 21:07:16 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:22.570 21:07:16 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:22.570 SPDK target shutdown done 00:06:22.570 21:07:16 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:06:22.570 Success 00:06:22.570 00:06:22.570 real 0m1.409s 00:06:22.570 user 0m1.166s 00:06:22.570 sys 0m0.370s 00:06:22.570 21:07:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:22.570 21:07:16 -- common/autotest_common.sh@10 -- # set +x 00:06:22.570 ************************************ 00:06:22.570 END TEST json_config_extra_key 00:06:22.570 ************************************ 00:06:22.828 21:07:16 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:22.828 21:07:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.828 21:07:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.828 21:07:16 -- common/autotest_common.sh@10 -- # set +x 00:06:22.828 ************************************ 00:06:22.828 START TEST alias_rpc 00:06:22.828 ************************************ 00:06:22.828 21:07:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:22.828 * Looking for test storage... 00:06:22.828 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:06:22.828 21:07:17 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:22.828 21:07:17 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1163930 00:06:22.828 21:07:17 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1163930 00:06:22.828 21:07:17 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:22.828 21:07:17 -- common/autotest_common.sh@817 -- # '[' -z 1163930 ']' 00:06:22.828 21:07:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.828 21:07:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:22.828 21:07:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.828 21:07:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:22.828 21:07:17 -- common/autotest_common.sh@10 -- # set +x 00:06:23.087 [2024-04-23 21:07:17.116754] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:23.087 [2024-04-23 21:07:17.116796] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163930 ] 00:06:23.087 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.087 [2024-04-23 21:07:17.167232] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.087 [2024-04-23 21:07:17.236549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.652 21:07:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:23.652 21:07:17 -- common/autotest_common.sh@850 -- # return 0 00:06:23.652 21:07:17 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:23.911 21:07:18 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1163930 00:06:23.911 21:07:18 -- common/autotest_common.sh@936 -- # '[' -z 1163930 ']' 00:06:23.911 21:07:18 -- common/autotest_common.sh@940 -- # kill -0 1163930 00:06:23.911 21:07:18 -- common/autotest_common.sh@941 -- # uname 00:06:23.911 21:07:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.911 21:07:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1163930 00:06:23.911 21:07:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.911 21:07:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.911 21:07:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1163930' 00:06:23.911 killing process with pid 1163930 00:06:23.911 21:07:18 -- common/autotest_common.sh@955 -- # kill 1163930 00:06:23.911 21:07:18 -- common/autotest_common.sh@960 -- # wait 1163930 00:06:24.169 00:06:24.169 real 0m1.443s 00:06:24.169 user 0m1.555s 00:06:24.169 sys 0m0.368s 00:06:24.169 21:07:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:24.169 21:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:24.169 ************************************ 00:06:24.169 END TEST alias_rpc 00:06:24.169 ************************************ 00:06:24.427 21:07:18 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:06:24.427 21:07:18 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:24.428 21:07:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.428 21:07:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.428 21:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:24.428 ************************************ 00:06:24.428 START TEST spdkcli_tcp 00:06:24.428 ************************************ 00:06:24.428 21:07:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:24.428 * Looking for test storage... 00:06:24.428 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:06:24.428 21:07:18 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:24.428 21:07:18 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:24.428 21:07:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:24.428 21:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1164256 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:24.428 21:07:18 -- spdkcli/tcp.sh@27 -- # waitforlisten 1164256 00:06:24.428 21:07:18 -- common/autotest_common.sh@817 -- # '[' -z 1164256 ']' 00:06:24.428 21:07:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:24.428 21:07:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:24.428 21:07:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:24.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:24.428 21:07:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:24.428 21:07:18 -- common/autotest_common.sh@10 -- # set +x 00:06:24.686 [2024-04-23 21:07:18.719683] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:24.686 [2024-04-23 21:07:18.719731] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164256 ] 00:06:24.686 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.686 [2024-04-23 21:07:18.770363] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:24.686 [2024-04-23 21:07:18.841624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.686 [2024-04-23 21:07:18.841626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.252 21:07:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:25.252 21:07:19 -- common/autotest_common.sh@850 -- # return 0 00:06:25.252 21:07:19 -- spdkcli/tcp.sh@31 -- # socat_pid=1164291 00:06:25.252 21:07:19 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:25.252 21:07:19 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:25.511 [ 00:06:25.511 "bdev_malloc_delete", 00:06:25.511 "bdev_malloc_create", 00:06:25.511 "bdev_null_resize", 00:06:25.511 "bdev_null_delete", 00:06:25.511 "bdev_null_create", 00:06:25.511 "bdev_nvme_cuse_unregister", 00:06:25.511 "bdev_nvme_cuse_register", 00:06:25.511 "bdev_opal_new_user", 00:06:25.511 "bdev_opal_set_lock_state", 00:06:25.511 "bdev_opal_delete", 00:06:25.511 "bdev_opal_get_info", 00:06:25.511 "bdev_opal_create", 00:06:25.511 "bdev_nvme_opal_revert", 00:06:25.511 "bdev_nvme_opal_init", 00:06:25.511 "bdev_nvme_send_cmd", 00:06:25.511 "bdev_nvme_get_path_iostat", 00:06:25.511 "bdev_nvme_get_mdns_discovery_info", 00:06:25.511 "bdev_nvme_stop_mdns_discovery", 00:06:25.511 "bdev_nvme_start_mdns_discovery", 00:06:25.511 "bdev_nvme_set_multipath_policy", 00:06:25.511 "bdev_nvme_set_preferred_path", 00:06:25.511 "bdev_nvme_get_io_paths", 00:06:25.511 "bdev_nvme_remove_error_injection", 00:06:25.511 "bdev_nvme_add_error_injection", 00:06:25.511 "bdev_nvme_get_discovery_info", 00:06:25.511 "bdev_nvme_stop_discovery", 00:06:25.511 "bdev_nvme_start_discovery", 00:06:25.511 "bdev_nvme_get_controller_health_info", 00:06:25.511 "bdev_nvme_disable_controller", 00:06:25.511 "bdev_nvme_enable_controller", 00:06:25.511 "bdev_nvme_reset_controller", 00:06:25.511 "bdev_nvme_get_transport_statistics", 00:06:25.511 "bdev_nvme_apply_firmware", 00:06:25.511 "bdev_nvme_detach_controller", 00:06:25.511 "bdev_nvme_get_controllers", 00:06:25.511 "bdev_nvme_attach_controller", 00:06:25.511 "bdev_nvme_set_hotplug", 00:06:25.511 "bdev_nvme_set_options", 00:06:25.511 "bdev_passthru_delete", 00:06:25.511 "bdev_passthru_create", 00:06:25.511 "bdev_lvol_grow_lvstore", 00:06:25.512 "bdev_lvol_get_lvols", 00:06:25.512 "bdev_lvol_get_lvstores", 00:06:25.512 "bdev_lvol_delete", 00:06:25.512 "bdev_lvol_set_read_only", 00:06:25.512 "bdev_lvol_resize", 00:06:25.512 "bdev_lvol_decouple_parent", 00:06:25.512 "bdev_lvol_inflate", 00:06:25.512 "bdev_lvol_rename", 00:06:25.512 "bdev_lvol_clone_bdev", 00:06:25.512 "bdev_lvol_clone", 00:06:25.512 "bdev_lvol_snapshot", 00:06:25.512 "bdev_lvol_create", 00:06:25.512 "bdev_lvol_delete_lvstore", 00:06:25.512 "bdev_lvol_rename_lvstore", 00:06:25.512 "bdev_lvol_create_lvstore", 00:06:25.512 "bdev_raid_set_options", 00:06:25.512 "bdev_raid_remove_base_bdev", 00:06:25.512 "bdev_raid_add_base_bdev", 00:06:25.512 "bdev_raid_delete", 00:06:25.512 "bdev_raid_create", 00:06:25.512 "bdev_raid_get_bdevs", 00:06:25.512 "bdev_error_inject_error", 00:06:25.512 "bdev_error_delete", 00:06:25.512 "bdev_error_create", 00:06:25.512 "bdev_split_delete", 00:06:25.512 "bdev_split_create", 00:06:25.512 "bdev_delay_delete", 00:06:25.512 "bdev_delay_create", 00:06:25.512 "bdev_delay_update_latency", 00:06:25.512 "bdev_zone_block_delete", 00:06:25.512 "bdev_zone_block_create", 00:06:25.512 "blobfs_create", 00:06:25.512 "blobfs_detect", 00:06:25.512 "blobfs_set_cache_size", 00:06:25.512 "bdev_aio_delete", 00:06:25.512 "bdev_aio_rescan", 00:06:25.512 "bdev_aio_create", 00:06:25.512 "bdev_ftl_set_property", 00:06:25.512 "bdev_ftl_get_properties", 00:06:25.512 "bdev_ftl_get_stats", 00:06:25.512 "bdev_ftl_unmap", 00:06:25.512 "bdev_ftl_unload", 00:06:25.512 "bdev_ftl_delete", 00:06:25.512 "bdev_ftl_load", 00:06:25.512 "bdev_ftl_create", 00:06:25.512 "bdev_virtio_attach_controller", 00:06:25.512 "bdev_virtio_scsi_get_devices", 00:06:25.512 "bdev_virtio_detach_controller", 00:06:25.512 "bdev_virtio_blk_set_hotplug", 00:06:25.512 "bdev_iscsi_delete", 00:06:25.512 "bdev_iscsi_create", 00:06:25.512 "bdev_iscsi_set_options", 00:06:25.512 "accel_error_inject_error", 00:06:25.512 "ioat_scan_accel_module", 00:06:25.512 "dsa_scan_accel_module", 00:06:25.512 "iaa_scan_accel_module", 00:06:25.512 "keyring_file_remove_key", 00:06:25.512 "keyring_file_add_key", 00:06:25.512 "iscsi_get_histogram", 00:06:25.512 "iscsi_enable_histogram", 00:06:25.512 "iscsi_set_options", 00:06:25.512 "iscsi_get_auth_groups", 00:06:25.512 "iscsi_auth_group_remove_secret", 00:06:25.512 "iscsi_auth_group_add_secret", 00:06:25.512 "iscsi_delete_auth_group", 00:06:25.512 "iscsi_create_auth_group", 00:06:25.512 "iscsi_set_discovery_auth", 00:06:25.512 "iscsi_get_options", 00:06:25.512 "iscsi_target_node_request_logout", 00:06:25.512 "iscsi_target_node_set_redirect", 00:06:25.512 "iscsi_target_node_set_auth", 00:06:25.512 "iscsi_target_node_add_lun", 00:06:25.512 "iscsi_get_stats", 00:06:25.512 "iscsi_get_connections", 00:06:25.512 "iscsi_portal_group_set_auth", 00:06:25.512 "iscsi_start_portal_group", 00:06:25.512 "iscsi_delete_portal_group", 00:06:25.512 "iscsi_create_portal_group", 00:06:25.512 "iscsi_get_portal_groups", 00:06:25.512 "iscsi_delete_target_node", 00:06:25.512 "iscsi_target_node_remove_pg_ig_maps", 00:06:25.512 "iscsi_target_node_add_pg_ig_maps", 00:06:25.512 "iscsi_create_target_node", 00:06:25.512 "iscsi_get_target_nodes", 00:06:25.512 "iscsi_delete_initiator_group", 00:06:25.512 "iscsi_initiator_group_remove_initiators", 00:06:25.512 "iscsi_initiator_group_add_initiators", 00:06:25.512 "iscsi_create_initiator_group", 00:06:25.512 "iscsi_get_initiator_groups", 00:06:25.512 "nvmf_set_crdt", 00:06:25.512 "nvmf_set_config", 00:06:25.512 "nvmf_set_max_subsystems", 00:06:25.512 "nvmf_subsystem_get_listeners", 00:06:25.512 "nvmf_subsystem_get_qpairs", 00:06:25.512 "nvmf_subsystem_get_controllers", 00:06:25.512 "nvmf_get_stats", 00:06:25.512 "nvmf_get_transports", 00:06:25.512 "nvmf_create_transport", 00:06:25.512 "nvmf_get_targets", 00:06:25.512 "nvmf_delete_target", 00:06:25.512 "nvmf_create_target", 00:06:25.512 "nvmf_subsystem_allow_any_host", 00:06:25.512 "nvmf_subsystem_remove_host", 00:06:25.512 "nvmf_subsystem_add_host", 00:06:25.512 "nvmf_ns_remove_host", 00:06:25.512 "nvmf_ns_add_host", 00:06:25.512 "nvmf_subsystem_remove_ns", 00:06:25.512 "nvmf_subsystem_add_ns", 00:06:25.512 "nvmf_subsystem_listener_set_ana_state", 00:06:25.512 "nvmf_discovery_get_referrals", 00:06:25.512 "nvmf_discovery_remove_referral", 00:06:25.512 "nvmf_discovery_add_referral", 00:06:25.512 "nvmf_subsystem_remove_listener", 00:06:25.512 "nvmf_subsystem_add_listener", 00:06:25.512 "nvmf_delete_subsystem", 00:06:25.512 "nvmf_create_subsystem", 00:06:25.512 "nvmf_get_subsystems", 00:06:25.512 "env_dpdk_get_mem_stats", 00:06:25.512 "nbd_get_disks", 00:06:25.512 "nbd_stop_disk", 00:06:25.512 "nbd_start_disk", 00:06:25.512 "ublk_recover_disk", 00:06:25.512 "ublk_get_disks", 00:06:25.512 "ublk_stop_disk", 00:06:25.512 "ublk_start_disk", 00:06:25.512 "ublk_destroy_target", 00:06:25.512 "ublk_create_target", 00:06:25.512 "virtio_blk_create_transport", 00:06:25.512 "virtio_blk_get_transports", 00:06:25.512 "vhost_controller_set_coalescing", 00:06:25.512 "vhost_get_controllers", 00:06:25.512 "vhost_delete_controller", 00:06:25.512 "vhost_create_blk_controller", 00:06:25.512 "vhost_scsi_controller_remove_target", 00:06:25.512 "vhost_scsi_controller_add_target", 00:06:25.512 "vhost_start_scsi_controller", 00:06:25.512 "vhost_create_scsi_controller", 00:06:25.512 "thread_set_cpumask", 00:06:25.512 "framework_get_scheduler", 00:06:25.512 "framework_set_scheduler", 00:06:25.512 "framework_get_reactors", 00:06:25.512 "thread_get_io_channels", 00:06:25.512 "thread_get_pollers", 00:06:25.512 "thread_get_stats", 00:06:25.512 "framework_monitor_context_switch", 00:06:25.512 "spdk_kill_instance", 00:06:25.512 "log_enable_timestamps", 00:06:25.512 "log_get_flags", 00:06:25.512 "log_clear_flag", 00:06:25.512 "log_set_flag", 00:06:25.512 "log_get_level", 00:06:25.512 "log_set_level", 00:06:25.512 "log_get_print_level", 00:06:25.512 "log_set_print_level", 00:06:25.512 "framework_enable_cpumask_locks", 00:06:25.512 "framework_disable_cpumask_locks", 00:06:25.512 "framework_wait_init", 00:06:25.512 "framework_start_init", 00:06:25.512 "scsi_get_devices", 00:06:25.512 "bdev_get_histogram", 00:06:25.512 "bdev_enable_histogram", 00:06:25.512 "bdev_set_qos_limit", 00:06:25.512 "bdev_set_qd_sampling_period", 00:06:25.512 "bdev_get_bdevs", 00:06:25.512 "bdev_reset_iostat", 00:06:25.512 "bdev_get_iostat", 00:06:25.512 "bdev_examine", 00:06:25.512 "bdev_wait_for_examine", 00:06:25.512 "bdev_set_options", 00:06:25.512 "notify_get_notifications", 00:06:25.512 "notify_get_types", 00:06:25.512 "accel_get_stats", 00:06:25.512 "accel_set_options", 00:06:25.512 "accel_set_driver", 00:06:25.512 "accel_crypto_key_destroy", 00:06:25.512 "accel_crypto_keys_get", 00:06:25.512 "accel_crypto_key_create", 00:06:25.512 "accel_assign_opc", 00:06:25.512 "accel_get_module_info", 00:06:25.512 "accel_get_opc_assignments", 00:06:25.512 "vmd_rescan", 00:06:25.512 "vmd_remove_device", 00:06:25.512 "vmd_enable", 00:06:25.513 "sock_set_default_impl", 00:06:25.513 "sock_impl_set_options", 00:06:25.513 "sock_impl_get_options", 00:06:25.513 "iobuf_get_stats", 00:06:25.513 "iobuf_set_options", 00:06:25.513 "framework_get_pci_devices", 00:06:25.513 "framework_get_config", 00:06:25.513 "framework_get_subsystems", 00:06:25.513 "trace_get_info", 00:06:25.513 "trace_get_tpoint_group_mask", 00:06:25.513 "trace_disable_tpoint_group", 00:06:25.513 "trace_enable_tpoint_group", 00:06:25.513 "trace_clear_tpoint_mask", 00:06:25.513 "trace_set_tpoint_mask", 00:06:25.513 "keyring_get_keys", 00:06:25.513 "spdk_get_version", 00:06:25.513 "rpc_get_methods" 00:06:25.513 ] 00:06:25.513 21:07:19 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:25.513 21:07:19 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:25.513 21:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:25.513 21:07:19 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:25.513 21:07:19 -- spdkcli/tcp.sh@38 -- # killprocess 1164256 00:06:25.513 21:07:19 -- common/autotest_common.sh@936 -- # '[' -z 1164256 ']' 00:06:25.513 21:07:19 -- common/autotest_common.sh@940 -- # kill -0 1164256 00:06:25.513 21:07:19 -- common/autotest_common.sh@941 -- # uname 00:06:25.513 21:07:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.513 21:07:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164256 00:06:25.513 21:07:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.513 21:07:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.513 21:07:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164256' 00:06:25.513 killing process with pid 1164256 00:06:25.513 21:07:19 -- common/autotest_common.sh@955 -- # kill 1164256 00:06:25.513 21:07:19 -- common/autotest_common.sh@960 -- # wait 1164256 00:06:26.080 00:06:26.080 real 0m1.498s 00:06:26.080 user 0m2.758s 00:06:26.080 sys 0m0.427s 00:06:26.080 21:07:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:26.080 21:07:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.080 ************************************ 00:06:26.080 END TEST spdkcli_tcp 00:06:26.080 ************************************ 00:06:26.080 21:07:20 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:26.080 21:07:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.080 21:07:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.080 21:07:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.080 ************************************ 00:06:26.080 START TEST dpdk_mem_utility 00:06:26.080 ************************************ 00:06:26.080 21:07:20 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:26.080 * Looking for test storage... 00:06:26.080 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:06:26.080 21:07:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:26.080 21:07:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1164602 00:06:26.080 21:07:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1164602 00:06:26.080 21:07:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:26.080 21:07:20 -- common/autotest_common.sh@817 -- # '[' -z 1164602 ']' 00:06:26.080 21:07:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.080 21:07:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:26.080 21:07:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.080 21:07:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:26.080 21:07:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.338 [2024-04-23 21:07:20.378589] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:26.338 [2024-04-23 21:07:20.378628] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164602 ] 00:06:26.338 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.338 [2024-04-23 21:07:20.429643] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.338 [2024-04-23 21:07:20.502010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.905 21:07:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:26.905 21:07:21 -- common/autotest_common.sh@850 -- # return 0 00:06:26.905 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:26.905 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:26.905 21:07:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:26.905 21:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:26.905 { 00:06:26.905 "filename": "/tmp/spdk_mem_dump.txt" 00:06:26.905 } 00:06:26.905 21:07:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:26.905 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:27.164 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:27.164 1 heaps totaling size 814.000000 MiB 00:06:27.164 size: 814.000000 MiB heap id: 0 00:06:27.164 end heaps---------- 00:06:27.164 8 mempools totaling size 598.116089 MiB 00:06:27.164 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:27.164 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:27.164 size: 84.521057 MiB name: bdev_io_1164602 00:06:27.164 size: 51.011292 MiB name: evtpool_1164602 00:06:27.164 size: 50.003479 MiB name: msgpool_1164602 00:06:27.164 size: 21.763794 MiB name: PDU_Pool 00:06:27.164 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:27.164 size: 0.026123 MiB name: Session_Pool 00:06:27.164 end mempools------- 00:06:27.164 6 memzones totaling size 4.142822 MiB 00:06:27.164 size: 1.000366 MiB name: RG_ring_0_1164602 00:06:27.164 size: 1.000366 MiB name: RG_ring_1_1164602 00:06:27.164 size: 1.000366 MiB name: RG_ring_4_1164602 00:06:27.164 size: 1.000366 MiB name: RG_ring_5_1164602 00:06:27.164 size: 0.125366 MiB name: RG_ring_2_1164602 00:06:27.164 size: 0.015991 MiB name: RG_ring_3_1164602 00:06:27.164 end memzones------- 00:06:27.164 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:27.164 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:27.164 list of free elements. size: 12.519348 MiB 00:06:27.164 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:27.164 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:27.164 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:27.164 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:27.164 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:27.164 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:27.164 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:27.164 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:27.164 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:27.164 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:27.164 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:27.164 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:27.164 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:27.164 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:27.164 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:27.164 list of standard malloc elements. size: 199.218079 MiB 00:06:27.164 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:27.164 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:27.164 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:27.164 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:27.164 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:27.164 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:27.164 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:27.164 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:27.164 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:27.164 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:27.164 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:27.164 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:27.164 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:27.165 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:27.165 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:27.165 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:27.165 list of memzone associated elements. size: 602.262573 MiB 00:06:27.165 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:27.165 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:27.165 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:27.165 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:27.165 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:27.165 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1164602_0 00:06:27.165 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:27.165 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1164602_0 00:06:27.165 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:27.165 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1164602_0 00:06:27.165 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:27.165 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:27.165 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:27.165 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:27.165 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:27.165 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1164602 00:06:27.165 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:27.165 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1164602 00:06:27.165 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:27.165 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1164602 00:06:27.165 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:27.165 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:27.165 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:27.165 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:27.165 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:27.165 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:27.165 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:27.165 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:27.165 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:27.165 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1164602 00:06:27.165 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:27.165 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1164602 00:06:27.165 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:27.165 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1164602 00:06:27.165 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:27.165 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1164602 00:06:27.165 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:27.165 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1164602 00:06:27.165 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:27.165 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:27.165 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:27.165 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:27.165 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:27.165 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:27.165 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:27.165 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1164602 00:06:27.165 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:27.165 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:27.165 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:27.165 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:27.165 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:27.165 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1164602 00:06:27.165 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:27.165 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:27.165 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:27.165 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1164602 00:06:27.165 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:27.165 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1164602 00:06:27.165 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:27.165 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:27.165 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:27.165 21:07:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1164602 00:06:27.165 21:07:21 -- common/autotest_common.sh@936 -- # '[' -z 1164602 ']' 00:06:27.165 21:07:21 -- common/autotest_common.sh@940 -- # kill -0 1164602 00:06:27.165 21:07:21 -- common/autotest_common.sh@941 -- # uname 00:06:27.165 21:07:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.165 21:07:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164602 00:06:27.165 21:07:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.165 21:07:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.165 21:07:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164602' 00:06:27.165 killing process with pid 1164602 00:06:27.165 21:07:21 -- common/autotest_common.sh@955 -- # kill 1164602 00:06:27.165 21:07:21 -- common/autotest_common.sh@960 -- # wait 1164602 00:06:27.425 00:06:27.425 real 0m1.364s 00:06:27.425 user 0m1.423s 00:06:27.425 sys 0m0.370s 00:06:27.425 21:07:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:27.425 21:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:27.425 ************************************ 00:06:27.425 END TEST dpdk_mem_utility 00:06:27.425 ************************************ 00:06:27.425 21:07:21 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:06:27.425 21:07:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.425 21:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.425 21:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:27.683 ************************************ 00:06:27.683 START TEST event 00:06:27.683 ************************************ 00:06:27.683 21:07:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:06:27.683 * Looking for test storage... 00:06:27.683 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:06:27.683 21:07:21 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:27.683 21:07:21 -- bdev/nbd_common.sh@6 -- # set -e 00:06:27.683 21:07:21 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:27.683 21:07:21 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:27.683 21:07:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.683 21:07:21 -- common/autotest_common.sh@10 -- # set +x 00:06:27.683 ************************************ 00:06:27.683 START TEST event_perf 00:06:27.683 ************************************ 00:06:27.683 21:07:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:27.942 Running I/O for 1 seconds...[2024-04-23 21:07:21.966297] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:27.942 [2024-04-23 21:07:21.966374] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164940 ] 00:06:27.942 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.942 [2024-04-23 21:07:22.020076] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.942 [2024-04-23 21:07:22.086484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.942 [2024-04-23 21:07:22.086581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.942 [2024-04-23 21:07:22.086655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.942 [2024-04-23 21:07:22.086657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.321 Running I/O for 1 seconds... 00:06:29.321 lcore 0: 209266 00:06:29.321 lcore 1: 209265 00:06:29.321 lcore 2: 209265 00:06:29.321 lcore 3: 209266 00:06:29.321 done. 00:06:29.321 00:06:29.321 real 0m1.218s 00:06:29.321 user 0m4.142s 00:06:29.321 sys 0m0.072s 00:06:29.321 21:07:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:29.321 21:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:29.321 ************************************ 00:06:29.321 END TEST event_perf 00:06:29.321 ************************************ 00:06:29.321 21:07:23 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:29.321 21:07:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:29.321 21:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.321 21:07:23 -- common/autotest_common.sh@10 -- # set +x 00:06:29.322 ************************************ 00:06:29.322 START TEST event_reactor 00:06:29.322 ************************************ 00:06:29.322 21:07:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:29.322 [2024-04-23 21:07:23.322512] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:29.322 [2024-04-23 21:07:23.322582] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1165231 ] 00:06:29.322 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.322 [2024-04-23 21:07:23.378406] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.322 [2024-04-23 21:07:23.448415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.293 test_start 00:06:30.293 oneshot 00:06:30.293 tick 100 00:06:30.293 tick 100 00:06:30.293 tick 250 00:06:30.293 tick 100 00:06:30.293 tick 100 00:06:30.294 tick 100 00:06:30.294 tick 250 00:06:30.294 tick 500 00:06:30.294 tick 100 00:06:30.294 tick 100 00:06:30.294 tick 250 00:06:30.294 tick 100 00:06:30.294 tick 100 00:06:30.294 test_end 00:06:30.294 00:06:30.294 real 0m1.223s 00:06:30.294 user 0m1.147s 00:06:30.294 sys 0m0.072s 00:06:30.294 21:07:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:30.294 21:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:30.294 ************************************ 00:06:30.294 END TEST event_reactor 00:06:30.294 ************************************ 00:06:30.294 21:07:24 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:30.294 21:07:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:30.294 21:07:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.294 21:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:30.553 ************************************ 00:06:30.553 START TEST event_reactor_perf 00:06:30.553 ************************************ 00:06:30.553 21:07:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:30.553 [2024-04-23 21:07:24.672852] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:30.553 [2024-04-23 21:07:24.672927] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1165519 ] 00:06:30.553 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.553 [2024-04-23 21:07:24.726635] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.553 [2024-04-23 21:07:24.791994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.933 test_start 00:06:31.933 test_end 00:06:31.933 Performance: 552956 events per second 00:06:31.933 00:06:31.933 real 0m1.216s 00:06:31.933 user 0m1.145s 00:06:31.933 sys 0m0.067s 00:06:31.933 21:07:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:31.933 21:07:25 -- common/autotest_common.sh@10 -- # set +x 00:06:31.933 ************************************ 00:06:31.933 END TEST event_reactor_perf 00:06:31.933 ************************************ 00:06:31.933 21:07:25 -- event/event.sh@49 -- # uname -s 00:06:31.933 21:07:25 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:31.933 21:07:25 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:31.933 21:07:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.933 21:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.933 21:07:25 -- common/autotest_common.sh@10 -- # set +x 00:06:31.933 ************************************ 00:06:31.933 START TEST event_scheduler 00:06:31.933 ************************************ 00:06:31.933 21:07:26 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:31.933 * Looking for test storage... 00:06:31.933 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:06:31.933 21:07:26 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:31.933 21:07:26 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1165841 00:06:31.933 21:07:26 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:31.933 21:07:26 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:31.933 21:07:26 -- scheduler/scheduler.sh@37 -- # waitforlisten 1165841 00:06:31.933 21:07:26 -- common/autotest_common.sh@817 -- # '[' -z 1165841 ']' 00:06:31.933 21:07:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.933 21:07:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:31.933 21:07:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.933 21:07:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:31.933 21:07:26 -- common/autotest_common.sh@10 -- # set +x 00:06:31.933 [2024-04-23 21:07:26.166391] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:31.933 [2024-04-23 21:07:26.166433] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1165841 ] 00:06:31.933 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.195 [2024-04-23 21:07:26.217634] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:32.195 [2024-04-23 21:07:26.285726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.195 [2024-04-23 21:07:26.285809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:32.195 [2024-04-23 21:07:26.285890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:32.195 [2024-04-23 21:07:26.285891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:32.763 21:07:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:32.763 21:07:26 -- common/autotest_common.sh@850 -- # return 0 00:06:32.763 21:07:26 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:32.763 21:07:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.763 21:07:26 -- common/autotest_common.sh@10 -- # set +x 00:06:32.763 POWER: Env isn't set yet! 00:06:32.763 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:32.763 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:06:32.763 POWER: Cannot set governor of lcore 0 to userspace 00:06:32.763 POWER: Attempting to initialise PSTAT power management... 00:06:32.763 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:32.763 POWER: Initialized successfully for lcore 0 power management 00:06:32.763 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:32.763 POWER: Initialized successfully for lcore 1 power management 00:06:32.763 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:32.763 POWER: Initialized successfully for lcore 2 power management 00:06:32.763 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:32.763 POWER: Initialized successfully for lcore 3 power management 00:06:32.763 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.763 21:07:27 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:32.763 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.763 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 [2024-04-23 21:07:27.077449] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:33.023 21:07:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.023 21:07:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 ************************************ 00:06:33.023 START TEST scheduler_create_thread 00:06:33.023 ************************************ 00:06:33.023 21:07:27 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 2 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 3 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 4 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 5 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 6 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 7 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 8 00:06:33.023 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.023 21:07:27 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:33.023 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.023 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.023 9 00:06:33.282 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.282 21:07:27 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:33.282 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.282 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.282 10 00:06:33.282 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.282 21:07:27 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:33.282 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.282 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:33.282 21:07:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:33.282 21:07:27 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:33.282 21:07:27 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:33.282 21:07:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:33.282 21:07:27 -- common/autotest_common.sh@10 -- # set +x 00:06:34.218 21:07:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:34.218 21:07:28 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:34.218 21:07:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:34.218 21:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:35.594 21:07:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:35.594 21:07:29 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:35.594 21:07:29 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:35.594 21:07:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:35.594 21:07:29 -- common/autotest_common.sh@10 -- # set +x 00:06:36.528 21:07:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:36.528 00:06:36.528 real 0m3.383s 00:06:36.528 user 0m0.026s 00:06:36.528 sys 0m0.001s 00:06:36.528 21:07:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:36.528 21:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:36.528 ************************************ 00:06:36.528 END TEST scheduler_create_thread 00:06:36.528 ************************************ 00:06:36.528 21:07:30 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:36.528 21:07:30 -- scheduler/scheduler.sh@46 -- # killprocess 1165841 00:06:36.528 21:07:30 -- common/autotest_common.sh@936 -- # '[' -z 1165841 ']' 00:06:36.528 21:07:30 -- common/autotest_common.sh@940 -- # kill -0 1165841 00:06:36.528 21:07:30 -- common/autotest_common.sh@941 -- # uname 00:06:36.528 21:07:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.528 21:07:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1165841 00:06:36.528 21:07:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:36.528 21:07:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:36.528 21:07:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1165841' 00:06:36.528 killing process with pid 1165841 00:06:36.528 21:07:30 -- common/autotest_common.sh@955 -- # kill 1165841 00:06:36.528 21:07:30 -- common/autotest_common.sh@960 -- # wait 1165841 00:06:36.786 [2024-04-23 21:07:30.969702] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:37.044 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:06:37.044 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:37.044 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:06:37.044 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:37.044 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:06:37.044 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:37.044 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:06:37.044 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:37.044 00:06:37.044 real 0m5.179s 00:06:37.044 user 0m10.683s 00:06:37.044 sys 0m0.404s 00:06:37.044 21:07:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:37.044 21:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:37.044 ************************************ 00:06:37.044 END TEST event_scheduler 00:06:37.044 ************************************ 00:06:37.044 21:07:31 -- event/event.sh@51 -- # modprobe -n nbd 00:06:37.044 21:07:31 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:37.044 21:07:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.044 21:07:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.044 21:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:37.303 ************************************ 00:06:37.303 START TEST app_repeat 00:06:37.303 ************************************ 00:06:37.303 21:07:31 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:06:37.303 21:07:31 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:37.303 21:07:31 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:37.303 21:07:31 -- event/event.sh@13 -- # local nbd_list 00:06:37.303 21:07:31 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:37.303 21:07:31 -- event/event.sh@14 -- # local bdev_list 00:06:37.303 21:07:31 -- event/event.sh@15 -- # local repeat_times=4 00:06:37.303 21:07:31 -- event/event.sh@17 -- # modprobe nbd 00:06:37.303 21:07:31 -- event/event.sh@19 -- # repeat_pid=1166950 00:06:37.303 21:07:31 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:37.303 21:07:31 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:37.303 21:07:31 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1166950' 00:06:37.303 Process app_repeat pid: 1166950 00:06:37.303 21:07:31 -- event/event.sh@23 -- # for i in {0..2} 00:06:37.304 21:07:31 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:37.304 spdk_app_start Round 0 00:06:37.304 21:07:31 -- event/event.sh@25 -- # waitforlisten 1166950 /var/tmp/spdk-nbd.sock 00:06:37.304 21:07:31 -- common/autotest_common.sh@817 -- # '[' -z 1166950 ']' 00:06:37.304 21:07:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:37.304 21:07:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:37.304 21:07:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:37.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:37.304 21:07:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:37.304 21:07:31 -- common/autotest_common.sh@10 -- # set +x 00:06:37.304 [2024-04-23 21:07:31.424503] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:37.304 [2024-04-23 21:07:31.424553] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1166950 ] 00:06:37.304 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.304 [2024-04-23 21:07:31.478405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:37.304 [2024-04-23 21:07:31.543740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:37.304 [2024-04-23 21:07:31.543743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.239 21:07:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:38.239 21:07:32 -- common/autotest_common.sh@850 -- # return 0 00:06:38.239 21:07:32 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.239 Malloc0 00:06:38.239 21:07:32 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:38.520 Malloc1 00:06:38.520 21:07:32 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@12 -- # local i 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:38.520 /dev/nbd0 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:38.520 21:07:32 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:38.520 21:07:32 -- common/autotest_common.sh@855 -- # local i 00:06:38.520 21:07:32 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:38.520 21:07:32 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:38.520 21:07:32 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:38.520 21:07:32 -- common/autotest_common.sh@859 -- # break 00:06:38.520 21:07:32 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:38.520 21:07:32 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:38.520 21:07:32 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:38.520 1+0 records in 00:06:38.520 1+0 records out 00:06:38.520 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000186694 s, 21.9 MB/s 00:06:38.520 21:07:32 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:38.520 21:07:32 -- common/autotest_common.sh@872 -- # size=4096 00:06:38.520 21:07:32 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:38.520 21:07:32 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:38.520 21:07:32 -- common/autotest_common.sh@875 -- # return 0 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.520 21:07:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:38.778 /dev/nbd1 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:38.778 21:07:32 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:38.778 21:07:32 -- common/autotest_common.sh@855 -- # local i 00:06:38.778 21:07:32 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:38.778 21:07:32 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:38.778 21:07:32 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:38.778 21:07:32 -- common/autotest_common.sh@859 -- # break 00:06:38.778 21:07:32 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:38.778 21:07:32 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:38.778 21:07:32 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:38.778 1+0 records in 00:06:38.778 1+0 records out 00:06:38.778 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000122849 s, 33.3 MB/s 00:06:38.778 21:07:32 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:38.778 21:07:32 -- common/autotest_common.sh@872 -- # size=4096 00:06:38.778 21:07:32 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:38.778 21:07:32 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:38.778 21:07:32 -- common/autotest_common.sh@875 -- # return 0 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:38.778 21:07:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:39.035 { 00:06:39.035 "nbd_device": "/dev/nbd0", 00:06:39.035 "bdev_name": "Malloc0" 00:06:39.035 }, 00:06:39.035 { 00:06:39.035 "nbd_device": "/dev/nbd1", 00:06:39.035 "bdev_name": "Malloc1" 00:06:39.035 } 00:06:39.035 ]' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:39.035 { 00:06:39.035 "nbd_device": "/dev/nbd0", 00:06:39.035 "bdev_name": "Malloc0" 00:06:39.035 }, 00:06:39.035 { 00:06:39.035 "nbd_device": "/dev/nbd1", 00:06:39.035 "bdev_name": "Malloc1" 00:06:39.035 } 00:06:39.035 ]' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:39.035 /dev/nbd1' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:39.035 /dev/nbd1' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@65 -- # count=2 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@95 -- # count=2 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:39.035 256+0 records in 00:06:39.035 256+0 records out 00:06:39.035 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104146 s, 101 MB/s 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:39.035 256+0 records in 00:06:39.035 256+0 records out 00:06:39.035 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125005 s, 83.9 MB/s 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:39.035 256+0 records in 00:06:39.035 256+0 records out 00:06:39.035 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134263 s, 78.1 MB/s 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:39.035 21:07:33 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.036 21:07:33 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:39.036 21:07:33 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:39.036 21:07:33 -- bdev/nbd_common.sh@51 -- # local i 00:06:39.036 21:07:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.036 21:07:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@41 -- # break 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@45 -- # return 0 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:39.293 21:07:33 -- bdev/nbd_common.sh@41 -- # break 00:06:39.294 21:07:33 -- bdev/nbd_common.sh@45 -- # return 0 00:06:39.294 21:07:33 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:39.294 21:07:33 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:39.294 21:07:33 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@65 -- # true 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@65 -- # count=0 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@104 -- # count=0 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:39.578 21:07:33 -- bdev/nbd_common.sh@109 -- # return 0 00:06:39.578 21:07:33 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:39.836 21:07:33 -- event/event.sh@35 -- # sleep 3 00:06:40.095 [2024-04-23 21:07:34.137875] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:40.095 [2024-04-23 21:07:34.196801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:40.095 [2024-04-23 21:07:34.196803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.095 [2024-04-23 21:07:34.237207] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:40.095 [2024-04-23 21:07:34.237248] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:43.382 21:07:36 -- event/event.sh@23 -- # for i in {0..2} 00:06:43.383 21:07:36 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:43.383 spdk_app_start Round 1 00:06:43.383 21:07:36 -- event/event.sh@25 -- # waitforlisten 1166950 /var/tmp/spdk-nbd.sock 00:06:43.383 21:07:36 -- common/autotest_common.sh@817 -- # '[' -z 1166950 ']' 00:06:43.383 21:07:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:43.383 21:07:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:43.383 21:07:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:43.383 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:43.383 21:07:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:43.383 21:07:36 -- common/autotest_common.sh@10 -- # set +x 00:06:43.383 21:07:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:43.383 21:07:37 -- common/autotest_common.sh@850 -- # return 0 00:06:43.383 21:07:37 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:43.383 Malloc0 00:06:43.383 21:07:37 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:43.383 Malloc1 00:06:43.383 21:07:37 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@12 -- # local i 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:43.383 /dev/nbd0 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:43.383 21:07:37 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:43.383 21:07:37 -- common/autotest_common.sh@855 -- # local i 00:06:43.383 21:07:37 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:43.383 21:07:37 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:43.383 21:07:37 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:43.383 21:07:37 -- common/autotest_common.sh@859 -- # break 00:06:43.383 21:07:37 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:43.383 21:07:37 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:43.383 21:07:37 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:43.383 1+0 records in 00:06:43.383 1+0 records out 00:06:43.383 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000186012 s, 22.0 MB/s 00:06:43.383 21:07:37 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:43.383 21:07:37 -- common/autotest_common.sh@872 -- # size=4096 00:06:43.383 21:07:37 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:43.383 21:07:37 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:43.383 21:07:37 -- common/autotest_common.sh@875 -- # return 0 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.383 21:07:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:43.642 /dev/nbd1 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:43.642 21:07:37 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:43.642 21:07:37 -- common/autotest_common.sh@855 -- # local i 00:06:43.642 21:07:37 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:43.642 21:07:37 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:43.642 21:07:37 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:43.642 21:07:37 -- common/autotest_common.sh@859 -- # break 00:06:43.642 21:07:37 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:43.642 21:07:37 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:43.642 21:07:37 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:43.642 1+0 records in 00:06:43.642 1+0 records out 00:06:43.642 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182138 s, 22.5 MB/s 00:06:43.642 21:07:37 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:43.642 21:07:37 -- common/autotest_common.sh@872 -- # size=4096 00:06:43.642 21:07:37 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:43.642 21:07:37 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:43.642 21:07:37 -- common/autotest_common.sh@875 -- # return 0 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.642 21:07:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:43.901 21:07:37 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:43.901 { 00:06:43.901 "nbd_device": "/dev/nbd0", 00:06:43.901 "bdev_name": "Malloc0" 00:06:43.901 }, 00:06:43.901 { 00:06:43.901 "nbd_device": "/dev/nbd1", 00:06:43.901 "bdev_name": "Malloc1" 00:06:43.901 } 00:06:43.901 ]' 00:06:43.901 21:07:37 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:43.901 { 00:06:43.901 "nbd_device": "/dev/nbd0", 00:06:43.901 "bdev_name": "Malloc0" 00:06:43.901 }, 00:06:43.901 { 00:06:43.901 "nbd_device": "/dev/nbd1", 00:06:43.901 "bdev_name": "Malloc1" 00:06:43.901 } 00:06:43.901 ]' 00:06:43.901 21:07:37 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:43.901 /dev/nbd1' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:43.901 /dev/nbd1' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@65 -- # count=2 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@95 -- # count=2 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:43.901 256+0 records in 00:06:43.901 256+0 records out 00:06:43.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103494 s, 101 MB/s 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:43.901 256+0 records in 00:06:43.901 256+0 records out 00:06:43.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133286 s, 78.7 MB/s 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:43.901 256+0 records in 00:06:43.901 256+0 records out 00:06:43.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013265 s, 79.0 MB/s 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@51 -- # local i 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:43.901 21:07:38 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@41 -- # break 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@45 -- # return 0 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:44.160 21:07:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@41 -- # break 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@45 -- # return 0 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@65 -- # true 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@65 -- # count=0 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@104 -- # count=0 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:44.418 21:07:38 -- bdev/nbd_common.sh@109 -- # return 0 00:06:44.418 21:07:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:44.676 21:07:38 -- event/event.sh@35 -- # sleep 3 00:06:44.936 [2024-04-23 21:07:39.011659] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:44.936 [2024-04-23 21:07:39.070568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:44.936 [2024-04-23 21:07:39.070570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.936 [2024-04-23 21:07:39.111743] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:44.936 [2024-04-23 21:07:39.111787] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:48.246 21:07:41 -- event/event.sh@23 -- # for i in {0..2} 00:06:48.246 21:07:41 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:48.246 spdk_app_start Round 2 00:06:48.246 21:07:41 -- event/event.sh@25 -- # waitforlisten 1166950 /var/tmp/spdk-nbd.sock 00:06:48.246 21:07:41 -- common/autotest_common.sh@817 -- # '[' -z 1166950 ']' 00:06:48.246 21:07:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:48.246 21:07:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:48.246 21:07:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:48.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:48.246 21:07:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:48.246 21:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:48.246 21:07:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:48.246 21:07:41 -- common/autotest_common.sh@850 -- # return 0 00:06:48.246 21:07:41 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:48.246 Malloc0 00:06:48.246 21:07:42 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:48.246 Malloc1 00:06:48.246 21:07:42 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@12 -- # local i 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:48.246 /dev/nbd0 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:48.246 21:07:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:48.246 21:07:42 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:48.246 21:07:42 -- common/autotest_common.sh@855 -- # local i 00:06:48.246 21:07:42 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:48.246 21:07:42 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:48.246 21:07:42 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:48.246 21:07:42 -- common/autotest_common.sh@859 -- # break 00:06:48.246 21:07:42 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:48.246 21:07:42 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:48.246 21:07:42 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:48.246 1+0 records in 00:06:48.246 1+0 records out 00:06:48.246 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203118 s, 20.2 MB/s 00:06:48.246 21:07:42 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:48.246 21:07:42 -- common/autotest_common.sh@872 -- # size=4096 00:06:48.246 21:07:42 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:48.246 21:07:42 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:48.246 21:07:42 -- common/autotest_common.sh@875 -- # return 0 00:06:48.247 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:48.247 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:48.247 21:07:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:48.505 /dev/nbd1 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:48.505 21:07:42 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:48.505 21:07:42 -- common/autotest_common.sh@855 -- # local i 00:06:48.505 21:07:42 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:48.505 21:07:42 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:48.505 21:07:42 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:48.505 21:07:42 -- common/autotest_common.sh@859 -- # break 00:06:48.505 21:07:42 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:48.505 21:07:42 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:48.505 21:07:42 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:48.505 1+0 records in 00:06:48.505 1+0 records out 00:06:48.505 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000181912 s, 22.5 MB/s 00:06:48.505 21:07:42 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:48.505 21:07:42 -- common/autotest_common.sh@872 -- # size=4096 00:06:48.505 21:07:42 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:48.505 21:07:42 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:48.505 21:07:42 -- common/autotest_common.sh@875 -- # return 0 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.505 21:07:42 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:48.764 { 00:06:48.764 "nbd_device": "/dev/nbd0", 00:06:48.764 "bdev_name": "Malloc0" 00:06:48.764 }, 00:06:48.764 { 00:06:48.764 "nbd_device": "/dev/nbd1", 00:06:48.764 "bdev_name": "Malloc1" 00:06:48.764 } 00:06:48.764 ]' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:48.764 { 00:06:48.764 "nbd_device": "/dev/nbd0", 00:06:48.764 "bdev_name": "Malloc0" 00:06:48.764 }, 00:06:48.764 { 00:06:48.764 "nbd_device": "/dev/nbd1", 00:06:48.764 "bdev_name": "Malloc1" 00:06:48.764 } 00:06:48.764 ]' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:48.764 /dev/nbd1' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:48.764 /dev/nbd1' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@65 -- # count=2 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@95 -- # count=2 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:48.764 256+0 records in 00:06:48.764 256+0 records out 00:06:48.764 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738524 s, 142 MB/s 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:48.764 256+0 records in 00:06:48.764 256+0 records out 00:06:48.764 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123456 s, 84.9 MB/s 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:48.764 256+0 records in 00:06:48.764 256+0 records out 00:06:48.764 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136612 s, 76.8 MB/s 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@51 -- # local i 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:48.764 21:07:42 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@41 -- # break 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@45 -- # return 0 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:49.023 21:07:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@41 -- # break 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@45 -- # return 0 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@65 -- # true 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@65 -- # count=0 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@104 -- # count=0 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:49.283 21:07:43 -- bdev/nbd_common.sh@109 -- # return 0 00:06:49.283 21:07:43 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:49.542 21:07:43 -- event/event.sh@35 -- # sleep 3 00:06:49.801 [2024-04-23 21:07:43.884781] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:49.801 [2024-04-23 21:07:43.950430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:49.801 [2024-04-23 21:07:43.950432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.801 [2024-04-23 21:07:43.990378] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:49.801 [2024-04-23 21:07:43.990414] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:53.090 21:07:46 -- event/event.sh@38 -- # waitforlisten 1166950 /var/tmp/spdk-nbd.sock 00:06:53.090 21:07:46 -- common/autotest_common.sh@817 -- # '[' -z 1166950 ']' 00:06:53.090 21:07:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:53.090 21:07:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:53.090 21:07:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:53.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:53.090 21:07:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:53.090 21:07:46 -- common/autotest_common.sh@10 -- # set +x 00:06:53.090 21:07:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:53.090 21:07:46 -- common/autotest_common.sh@850 -- # return 0 00:06:53.090 21:07:46 -- event/event.sh@39 -- # killprocess 1166950 00:06:53.090 21:07:46 -- common/autotest_common.sh@936 -- # '[' -z 1166950 ']' 00:06:53.090 21:07:46 -- common/autotest_common.sh@940 -- # kill -0 1166950 00:06:53.090 21:07:46 -- common/autotest_common.sh@941 -- # uname 00:06:53.090 21:07:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:53.090 21:07:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1166950 00:06:53.090 21:07:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:53.090 21:07:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:53.090 21:07:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1166950' 00:06:53.090 killing process with pid 1166950 00:06:53.090 21:07:46 -- common/autotest_common.sh@955 -- # kill 1166950 00:06:53.090 21:07:46 -- common/autotest_common.sh@960 -- # wait 1166950 00:06:53.090 spdk_app_start is called in Round 0. 00:06:53.090 Shutdown signal received, stop current app iteration 00:06:53.090 Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 reinitialization... 00:06:53.090 spdk_app_start is called in Round 1. 00:06:53.090 Shutdown signal received, stop current app iteration 00:06:53.090 Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 reinitialization... 00:06:53.090 spdk_app_start is called in Round 2. 00:06:53.090 Shutdown signal received, stop current app iteration 00:06:53.090 Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 reinitialization... 00:06:53.090 spdk_app_start is called in Round 3. 00:06:53.090 Shutdown signal received, stop current app iteration 00:06:53.090 21:07:47 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:53.090 21:07:47 -- event/event.sh@42 -- # return 0 00:06:53.090 00:06:53.090 real 0m15.685s 00:06:53.090 user 0m33.695s 00:06:53.090 sys 0m2.135s 00:06:53.090 21:07:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:53.090 21:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.090 ************************************ 00:06:53.090 END TEST app_repeat 00:06:53.090 ************************************ 00:06:53.090 21:07:47 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:53.090 21:07:47 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:53.090 21:07:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.090 21:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.090 21:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.090 ************************************ 00:06:53.090 START TEST cpu_locks 00:06:53.090 ************************************ 00:06:53.090 21:07:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:53.090 * Looking for test storage... 00:06:53.090 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:06:53.090 21:07:47 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:53.090 21:07:47 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:53.090 21:07:47 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:53.090 21:07:47 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:53.090 21:07:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:53.090 21:07:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.090 21:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.350 ************************************ 00:06:53.350 START TEST default_locks 00:06:53.350 ************************************ 00:06:53.350 21:07:47 -- common/autotest_common.sh@1111 -- # default_locks 00:06:53.350 21:07:47 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1170085 00:06:53.350 21:07:47 -- event/cpu_locks.sh@47 -- # waitforlisten 1170085 00:06:53.350 21:07:47 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:53.350 21:07:47 -- common/autotest_common.sh@817 -- # '[' -z 1170085 ']' 00:06:53.350 21:07:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.350 21:07:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:53.350 21:07:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.350 21:07:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:53.350 21:07:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.350 [2024-04-23 21:07:47.500843] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:53.350 [2024-04-23 21:07:47.500881] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170085 ] 00:06:53.350 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.350 [2024-04-23 21:07:47.550654] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.350 [2024-04-23 21:07:47.613363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.288 21:07:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:54.288 21:07:48 -- common/autotest_common.sh@850 -- # return 0 00:06:54.288 21:07:48 -- event/cpu_locks.sh@49 -- # locks_exist 1170085 00:06:54.288 21:07:48 -- event/cpu_locks.sh@22 -- # lslocks -p 1170085 00:06:54.288 21:07:48 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:54.546 lslocks: write error 00:06:54.805 21:07:48 -- event/cpu_locks.sh@50 -- # killprocess 1170085 00:06:54.805 21:07:48 -- common/autotest_common.sh@936 -- # '[' -z 1170085 ']' 00:06:54.805 21:07:48 -- common/autotest_common.sh@940 -- # kill -0 1170085 00:06:54.805 21:07:48 -- common/autotest_common.sh@941 -- # uname 00:06:54.805 21:07:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:54.805 21:07:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170085 00:06:54.805 21:07:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:54.805 21:07:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:54.805 21:07:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170085' 00:06:54.805 killing process with pid 1170085 00:06:54.805 21:07:48 -- common/autotest_common.sh@955 -- # kill 1170085 00:06:54.805 21:07:48 -- common/autotest_common.sh@960 -- # wait 1170085 00:06:55.066 21:07:49 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1170085 00:06:55.066 21:07:49 -- common/autotest_common.sh@638 -- # local es=0 00:06:55.066 21:07:49 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1170085 00:06:55.066 21:07:49 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:06:55.066 21:07:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:55.066 21:07:49 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:06:55.066 21:07:49 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:55.066 21:07:49 -- common/autotest_common.sh@641 -- # waitforlisten 1170085 00:06:55.066 21:07:49 -- common/autotest_common.sh@817 -- # '[' -z 1170085 ']' 00:06:55.066 21:07:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:55.066 21:07:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:55.066 21:07:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:55.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:55.066 21:07:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:55.066 21:07:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.066 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1170085) - No such process 00:06:55.066 ERROR: process (pid: 1170085) is no longer running 00:06:55.066 21:07:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:55.066 21:07:49 -- common/autotest_common.sh@850 -- # return 1 00:06:55.066 21:07:49 -- common/autotest_common.sh@641 -- # es=1 00:06:55.066 21:07:49 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:55.066 21:07:49 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:55.066 21:07:49 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:55.066 21:07:49 -- event/cpu_locks.sh@54 -- # no_locks 00:06:55.066 21:07:49 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:55.066 21:07:49 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:55.066 21:07:49 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:55.066 00:06:55.066 real 0m1.740s 00:06:55.066 user 0m1.830s 00:06:55.066 sys 0m0.539s 00:06:55.066 21:07:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:55.066 21:07:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.066 ************************************ 00:06:55.066 END TEST default_locks 00:06:55.066 ************************************ 00:06:55.066 21:07:49 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:55.066 21:07:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:55.066 21:07:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.066 21:07:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.325 ************************************ 00:06:55.325 START TEST default_locks_via_rpc 00:06:55.326 ************************************ 00:06:55.326 21:07:49 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:06:55.326 21:07:49 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1170394 00:06:55.326 21:07:49 -- event/cpu_locks.sh@63 -- # waitforlisten 1170394 00:06:55.326 21:07:49 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:55.326 21:07:49 -- common/autotest_common.sh@817 -- # '[' -z 1170394 ']' 00:06:55.326 21:07:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:55.326 21:07:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:55.326 21:07:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:55.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:55.326 21:07:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:55.326 21:07:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.326 [2024-04-23 21:07:49.414756] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:55.326 [2024-04-23 21:07:49.414798] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170394 ] 00:06:55.326 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.326 [2024-04-23 21:07:49.467080] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.326 [2024-04-23 21:07:49.533334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.262 21:07:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:56.262 21:07:50 -- common/autotest_common.sh@850 -- # return 0 00:06:56.262 21:07:50 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:56.262 21:07:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:56.262 21:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:56.262 21:07:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:56.262 21:07:50 -- event/cpu_locks.sh@67 -- # no_locks 00:06:56.262 21:07:50 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:56.262 21:07:50 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:56.262 21:07:50 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:56.262 21:07:50 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:56.262 21:07:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:56.262 21:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:56.262 21:07:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:56.262 21:07:50 -- event/cpu_locks.sh@71 -- # locks_exist 1170394 00:06:56.262 21:07:50 -- event/cpu_locks.sh@22 -- # lslocks -p 1170394 00:06:56.262 21:07:50 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:56.262 21:07:50 -- event/cpu_locks.sh@73 -- # killprocess 1170394 00:06:56.262 21:07:50 -- common/autotest_common.sh@936 -- # '[' -z 1170394 ']' 00:06:56.262 21:07:50 -- common/autotest_common.sh@940 -- # kill -0 1170394 00:06:56.262 21:07:50 -- common/autotest_common.sh@941 -- # uname 00:06:56.262 21:07:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.262 21:07:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170394 00:06:56.262 21:07:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:56.262 21:07:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:56.262 21:07:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170394' 00:06:56.262 killing process with pid 1170394 00:06:56.262 21:07:50 -- common/autotest_common.sh@955 -- # kill 1170394 00:06:56.262 21:07:50 -- common/autotest_common.sh@960 -- # wait 1170394 00:06:56.831 00:06:56.831 real 0m1.476s 00:06:56.831 user 0m1.516s 00:06:56.831 sys 0m0.477s 00:06:56.831 21:07:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.831 21:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:56.831 ************************************ 00:06:56.831 END TEST default_locks_via_rpc 00:06:56.831 ************************************ 00:06:56.831 21:07:50 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:56.831 21:07:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:56.831 21:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.831 21:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:56.831 ************************************ 00:06:56.831 START TEST non_locking_app_on_locked_coremask 00:06:56.831 ************************************ 00:06:56.831 21:07:50 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:06:56.831 21:07:50 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1170719 00:06:56.831 21:07:50 -- event/cpu_locks.sh@81 -- # waitforlisten 1170719 /var/tmp/spdk.sock 00:06:56.831 21:07:50 -- common/autotest_common.sh@817 -- # '[' -z 1170719 ']' 00:06:56.831 21:07:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:56.831 21:07:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:56.831 21:07:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:56.831 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:56.831 21:07:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:56.831 21:07:50 -- common/autotest_common.sh@10 -- # set +x 00:06:56.831 21:07:50 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:56.831 [2024-04-23 21:07:51.025962] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:56.831 [2024-04-23 21:07:51.025998] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170719 ] 00:06:56.831 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.831 [2024-04-23 21:07:51.075789] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.091 [2024-04-23 21:07:51.146978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.659 21:07:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:57.659 21:07:51 -- common/autotest_common.sh@850 -- # return 0 00:06:57.659 21:07:51 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1170953 00:06:57.659 21:07:51 -- event/cpu_locks.sh@85 -- # waitforlisten 1170953 /var/tmp/spdk2.sock 00:06:57.659 21:07:51 -- common/autotest_common.sh@817 -- # '[' -z 1170953 ']' 00:06:57.659 21:07:51 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:57.659 21:07:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:57.659 21:07:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:57.659 21:07:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:57.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:57.659 21:07:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:57.659 21:07:51 -- common/autotest_common.sh@10 -- # set +x 00:06:57.659 [2024-04-23 21:07:51.806268] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:06:57.659 [2024-04-23 21:07:51.806335] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1170953 ] 00:06:57.659 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.659 [2024-04-23 21:07:51.872975] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:57.659 [2024-04-23 21:07:51.872997] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.919 [2024-04-23 21:07:52.001658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.488 21:07:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:58.488 21:07:52 -- common/autotest_common.sh@850 -- # return 0 00:06:58.488 21:07:52 -- event/cpu_locks.sh@87 -- # locks_exist 1170719 00:06:58.488 21:07:52 -- event/cpu_locks.sh@22 -- # lslocks -p 1170719 00:06:58.488 21:07:52 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:58.747 lslocks: write error 00:06:58.747 21:07:53 -- event/cpu_locks.sh@89 -- # killprocess 1170719 00:06:58.747 21:07:53 -- common/autotest_common.sh@936 -- # '[' -z 1170719 ']' 00:06:58.748 21:07:53 -- common/autotest_common.sh@940 -- # kill -0 1170719 00:06:58.748 21:07:53 -- common/autotest_common.sh@941 -- # uname 00:06:58.748 21:07:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.748 21:07:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170719 00:06:59.009 21:07:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:59.009 21:07:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:59.009 21:07:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170719' 00:06:59.009 killing process with pid 1170719 00:06:59.009 21:07:53 -- common/autotest_common.sh@955 -- # kill 1170719 00:06:59.009 21:07:53 -- common/autotest_common.sh@960 -- # wait 1170719 00:06:59.576 21:07:53 -- event/cpu_locks.sh@90 -- # killprocess 1170953 00:06:59.576 21:07:53 -- common/autotest_common.sh@936 -- # '[' -z 1170953 ']' 00:06:59.576 21:07:53 -- common/autotest_common.sh@940 -- # kill -0 1170953 00:06:59.576 21:07:53 -- common/autotest_common.sh@941 -- # uname 00:06:59.576 21:07:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:59.576 21:07:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1170953 00:06:59.576 21:07:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:59.576 21:07:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:59.576 21:07:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1170953' 00:06:59.576 killing process with pid 1170953 00:06:59.576 21:07:53 -- common/autotest_common.sh@955 -- # kill 1170953 00:06:59.576 21:07:53 -- common/autotest_common.sh@960 -- # wait 1170953 00:06:59.835 00:06:59.835 real 0m3.080s 00:06:59.835 user 0m3.223s 00:06:59.835 sys 0m0.840s 00:06:59.835 21:07:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:59.835 21:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:59.835 ************************************ 00:06:59.835 END TEST non_locking_app_on_locked_coremask 00:06:59.835 ************************************ 00:06:59.835 21:07:54 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:59.835 21:07:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:59.835 21:07:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.835 21:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:00.094 ************************************ 00:07:00.094 START TEST locking_app_on_unlocked_coremask 00:07:00.094 ************************************ 00:07:00.094 21:07:54 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:07:00.094 21:07:54 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1171512 00:07:00.094 21:07:54 -- event/cpu_locks.sh@99 -- # waitforlisten 1171512 /var/tmp/spdk.sock 00:07:00.094 21:07:54 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:00.094 21:07:54 -- common/autotest_common.sh@817 -- # '[' -z 1171512 ']' 00:07:00.094 21:07:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.094 21:07:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:00.094 21:07:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.094 21:07:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:00.094 21:07:54 -- common/autotest_common.sh@10 -- # set +x 00:07:00.094 [2024-04-23 21:07:54.265832] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:00.094 [2024-04-23 21:07:54.265871] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1171512 ] 00:07:00.094 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.094 [2024-04-23 21:07:54.315587] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:00.094 [2024-04-23 21:07:54.315610] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.353 [2024-04-23 21:07:54.380991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.920 21:07:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:00.920 21:07:55 -- common/autotest_common.sh@850 -- # return 0 00:07:00.920 21:07:55 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1171526 00:07:00.920 21:07:55 -- event/cpu_locks.sh@103 -- # waitforlisten 1171526 /var/tmp/spdk2.sock 00:07:00.920 21:07:55 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:00.920 21:07:55 -- common/autotest_common.sh@817 -- # '[' -z 1171526 ']' 00:07:00.920 21:07:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:00.920 21:07:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:00.920 21:07:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:00.920 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:00.920 21:07:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:00.920 21:07:55 -- common/autotest_common.sh@10 -- # set +x 00:07:00.920 [2024-04-23 21:07:55.072143] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:00.920 [2024-04-23 21:07:55.072184] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1171526 ] 00:07:00.920 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.920 [2024-04-23 21:07:55.139410] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.178 [2024-04-23 21:07:55.273653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.746 21:07:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:01.746 21:07:55 -- common/autotest_common.sh@850 -- # return 0 00:07:01.746 21:07:55 -- event/cpu_locks.sh@105 -- # locks_exist 1171526 00:07:01.746 21:07:55 -- event/cpu_locks.sh@22 -- # lslocks -p 1171526 00:07:01.746 21:07:55 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:02.313 lslocks: write error 00:07:02.313 21:07:56 -- event/cpu_locks.sh@107 -- # killprocess 1171512 00:07:02.313 21:07:56 -- common/autotest_common.sh@936 -- # '[' -z 1171512 ']' 00:07:02.313 21:07:56 -- common/autotest_common.sh@940 -- # kill -0 1171512 00:07:02.313 21:07:56 -- common/autotest_common.sh@941 -- # uname 00:07:02.313 21:07:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:02.313 21:07:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171512 00:07:02.313 21:07:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:02.313 21:07:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:02.313 21:07:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171512' 00:07:02.313 killing process with pid 1171512 00:07:02.313 21:07:56 -- common/autotest_common.sh@955 -- # kill 1171512 00:07:02.313 21:07:56 -- common/autotest_common.sh@960 -- # wait 1171512 00:07:02.883 21:07:57 -- event/cpu_locks.sh@108 -- # killprocess 1171526 00:07:02.883 21:07:57 -- common/autotest_common.sh@936 -- # '[' -z 1171526 ']' 00:07:02.883 21:07:57 -- common/autotest_common.sh@940 -- # kill -0 1171526 00:07:02.883 21:07:57 -- common/autotest_common.sh@941 -- # uname 00:07:02.883 21:07:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:02.883 21:07:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1171526 00:07:03.217 21:07:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:03.217 21:07:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:03.217 21:07:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1171526' 00:07:03.217 killing process with pid 1171526 00:07:03.217 21:07:57 -- common/autotest_common.sh@955 -- # kill 1171526 00:07:03.217 21:07:57 -- common/autotest_common.sh@960 -- # wait 1171526 00:07:03.476 00:07:03.476 real 0m3.276s 00:07:03.476 user 0m3.454s 00:07:03.476 sys 0m0.926s 00:07:03.476 21:07:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:03.476 21:07:57 -- common/autotest_common.sh@10 -- # set +x 00:07:03.476 ************************************ 00:07:03.476 END TEST locking_app_on_unlocked_coremask 00:07:03.476 ************************************ 00:07:03.476 21:07:57 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:03.476 21:07:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:03.476 21:07:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.476 21:07:57 -- common/autotest_common.sh@10 -- # set +x 00:07:03.476 ************************************ 00:07:03.476 START TEST locking_app_on_locked_coremask 00:07:03.476 ************************************ 00:07:03.476 21:07:57 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:07:03.476 21:07:57 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1172095 00:07:03.476 21:07:57 -- event/cpu_locks.sh@116 -- # waitforlisten 1172095 /var/tmp/spdk.sock 00:07:03.476 21:07:57 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:03.476 21:07:57 -- common/autotest_common.sh@817 -- # '[' -z 1172095 ']' 00:07:03.476 21:07:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:03.476 21:07:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:03.476 21:07:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:03.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:03.476 21:07:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:03.476 21:07:57 -- common/autotest_common.sh@10 -- # set +x 00:07:03.476 [2024-04-23 21:07:57.707696] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:03.476 [2024-04-23 21:07:57.707736] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172095 ] 00:07:03.476 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.735 [2024-04-23 21:07:57.758795] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.735 [2024-04-23 21:07:57.823660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.303 21:07:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:04.303 21:07:58 -- common/autotest_common.sh@850 -- # return 0 00:07:04.303 21:07:58 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1172337 00:07:04.303 21:07:58 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1172337 /var/tmp/spdk2.sock 00:07:04.303 21:07:58 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:04.303 21:07:58 -- common/autotest_common.sh@638 -- # local es=0 00:07:04.303 21:07:58 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1172337 /var/tmp/spdk2.sock 00:07:04.303 21:07:58 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:04.303 21:07:58 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.303 21:07:58 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:04.303 21:07:58 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:04.303 21:07:58 -- common/autotest_common.sh@641 -- # waitforlisten 1172337 /var/tmp/spdk2.sock 00:07:04.303 21:07:58 -- common/autotest_common.sh@817 -- # '[' -z 1172337 ']' 00:07:04.303 21:07:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:04.303 21:07:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:04.303 21:07:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:04.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:04.303 21:07:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:04.303 21:07:58 -- common/autotest_common.sh@10 -- # set +x 00:07:04.303 [2024-04-23 21:07:58.521082] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:04.303 [2024-04-23 21:07:58.521124] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172337 ] 00:07:04.303 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.562 [2024-04-23 21:07:58.593176] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1172095 has claimed it. 00:07:04.562 [2024-04-23 21:07:58.593211] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:05.130 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1172337) - No such process 00:07:05.130 ERROR: process (pid: 1172337) is no longer running 00:07:05.130 21:07:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:05.130 21:07:59 -- common/autotest_common.sh@850 -- # return 1 00:07:05.130 21:07:59 -- common/autotest_common.sh@641 -- # es=1 00:07:05.130 21:07:59 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:05.130 21:07:59 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:05.130 21:07:59 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:05.130 21:07:59 -- event/cpu_locks.sh@122 -- # locks_exist 1172095 00:07:05.130 21:07:59 -- event/cpu_locks.sh@22 -- # lslocks -p 1172095 00:07:05.130 21:07:59 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:05.389 lslocks: write error 00:07:05.389 21:07:59 -- event/cpu_locks.sh@124 -- # killprocess 1172095 00:07:05.389 21:07:59 -- common/autotest_common.sh@936 -- # '[' -z 1172095 ']' 00:07:05.389 21:07:59 -- common/autotest_common.sh@940 -- # kill -0 1172095 00:07:05.389 21:07:59 -- common/autotest_common.sh@941 -- # uname 00:07:05.389 21:07:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:05.389 21:07:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172095 00:07:05.389 21:07:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:05.389 21:07:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:05.389 21:07:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172095' 00:07:05.389 killing process with pid 1172095 00:07:05.389 21:07:59 -- common/autotest_common.sh@955 -- # kill 1172095 00:07:05.389 21:07:59 -- common/autotest_common.sh@960 -- # wait 1172095 00:07:05.957 00:07:05.957 real 0m2.301s 00:07:05.957 user 0m2.510s 00:07:05.957 sys 0m0.610s 00:07:05.957 21:07:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:05.957 21:07:59 -- common/autotest_common.sh@10 -- # set +x 00:07:05.957 ************************************ 00:07:05.957 END TEST locking_app_on_locked_coremask 00:07:05.957 ************************************ 00:07:05.957 21:07:59 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:05.957 21:07:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:05.957 21:07:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.957 21:07:59 -- common/autotest_common.sh@10 -- # set +x 00:07:05.957 ************************************ 00:07:05.957 START TEST locking_overlapped_coremask 00:07:05.957 ************************************ 00:07:05.957 21:08:00 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:07:05.957 21:08:00 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1172654 00:07:05.957 21:08:00 -- event/cpu_locks.sh@133 -- # waitforlisten 1172654 /var/tmp/spdk.sock 00:07:05.957 21:08:00 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:05.957 21:08:00 -- common/autotest_common.sh@817 -- # '[' -z 1172654 ']' 00:07:05.957 21:08:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.957 21:08:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:05.957 21:08:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.957 21:08:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:05.957 21:08:00 -- common/autotest_common.sh@10 -- # set +x 00:07:05.957 [2024-04-23 21:08:00.168255] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:05.957 [2024-04-23 21:08:00.168296] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172654 ] 00:07:05.957 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.957 [2024-04-23 21:08:00.218465] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:06.216 [2024-04-23 21:08:00.284656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:06.216 [2024-04-23 21:08:00.284744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.217 [2024-04-23 21:08:00.284746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:06.785 21:08:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:06.785 21:08:00 -- common/autotest_common.sh@850 -- # return 0 00:07:06.785 21:08:00 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:06.785 21:08:00 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1172675 00:07:06.785 21:08:00 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1172675 /var/tmp/spdk2.sock 00:07:06.785 21:08:00 -- common/autotest_common.sh@638 -- # local es=0 00:07:06.785 21:08:00 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 1172675 /var/tmp/spdk2.sock 00:07:06.785 21:08:00 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:06.785 21:08:00 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:06.785 21:08:00 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:06.785 21:08:00 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:06.785 21:08:00 -- common/autotest_common.sh@641 -- # waitforlisten 1172675 /var/tmp/spdk2.sock 00:07:06.785 21:08:00 -- common/autotest_common.sh@817 -- # '[' -z 1172675 ']' 00:07:06.785 21:08:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:06.785 21:08:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:06.785 21:08:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:06.785 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:06.785 21:08:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:06.785 21:08:00 -- common/autotest_common.sh@10 -- # set +x 00:07:06.785 [2024-04-23 21:08:00.954525] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:06.785 [2024-04-23 21:08:00.954568] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172675 ] 00:07:06.785 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.785 [2024-04-23 21:08:01.028246] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1172654 has claimed it. 00:07:06.785 [2024-04-23 21:08:01.028289] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:07.353 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (1172675) - No such process 00:07:07.353 ERROR: process (pid: 1172675) is no longer running 00:07:07.353 21:08:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:07.353 21:08:01 -- common/autotest_common.sh@850 -- # return 1 00:07:07.353 21:08:01 -- common/autotest_common.sh@641 -- # es=1 00:07:07.353 21:08:01 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:07.353 21:08:01 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:07.353 21:08:01 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:07.353 21:08:01 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:07.353 21:08:01 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:07.353 21:08:01 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:07.353 21:08:01 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:07.353 21:08:01 -- event/cpu_locks.sh@141 -- # killprocess 1172654 00:07:07.353 21:08:01 -- common/autotest_common.sh@936 -- # '[' -z 1172654 ']' 00:07:07.353 21:08:01 -- common/autotest_common.sh@940 -- # kill -0 1172654 00:07:07.353 21:08:01 -- common/autotest_common.sh@941 -- # uname 00:07:07.353 21:08:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:07.353 21:08:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172654 00:07:07.613 21:08:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:07.613 21:08:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:07.613 21:08:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172654' 00:07:07.613 killing process with pid 1172654 00:07:07.613 21:08:01 -- common/autotest_common.sh@955 -- # kill 1172654 00:07:07.613 21:08:01 -- common/autotest_common.sh@960 -- # wait 1172654 00:07:07.873 00:07:07.873 real 0m1.837s 00:07:07.873 user 0m5.140s 00:07:07.873 sys 0m0.379s 00:07:07.873 21:08:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:07.873 21:08:01 -- common/autotest_common.sh@10 -- # set +x 00:07:07.873 ************************************ 00:07:07.873 END TEST locking_overlapped_coremask 00:07:07.873 ************************************ 00:07:07.873 21:08:01 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:07.873 21:08:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:07.873 21:08:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.873 21:08:01 -- common/autotest_common.sh@10 -- # set +x 00:07:07.873 ************************************ 00:07:07.873 START TEST locking_overlapped_coremask_via_rpc 00:07:07.873 ************************************ 00:07:07.873 21:08:02 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:07:07.873 21:08:02 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1172969 00:07:07.873 21:08:02 -- event/cpu_locks.sh@149 -- # waitforlisten 1172969 /var/tmp/spdk.sock 00:07:07.873 21:08:02 -- common/autotest_common.sh@817 -- # '[' -z 1172969 ']' 00:07:07.873 21:08:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:07.873 21:08:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:07.873 21:08:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:07.873 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:07.873 21:08:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:07.873 21:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:07.873 21:08:02 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:07.873 [2024-04-23 21:08:02.122011] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:07.873 [2024-04-23 21:08:02.122048] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1172969 ] 00:07:07.873 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.132 [2024-04-23 21:08:02.174607] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:08.132 [2024-04-23 21:08:02.174629] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:08.132 [2024-04-23 21:08:02.244037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:08.132 [2024-04-23 21:08:02.244141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.132 [2024-04-23 21:08:02.244143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.701 21:08:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:08.701 21:08:02 -- common/autotest_common.sh@850 -- # return 0 00:07:08.701 21:08:02 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1173230 00:07:08.701 21:08:02 -- event/cpu_locks.sh@153 -- # waitforlisten 1173230 /var/tmp/spdk2.sock 00:07:08.701 21:08:02 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:08.701 21:08:02 -- common/autotest_common.sh@817 -- # '[' -z 1173230 ']' 00:07:08.701 21:08:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:08.701 21:08:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:08.701 21:08:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:08.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:08.701 21:08:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:08.701 21:08:02 -- common/autotest_common.sh@10 -- # set +x 00:07:08.701 [2024-04-23 21:08:02.937343] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:08.701 [2024-04-23 21:08:02.937383] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1173230 ] 00:07:08.701 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.961 [2024-04-23 21:08:03.008788] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:08.961 [2024-04-23 21:08:03.008812] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:08.961 [2024-04-23 21:08:03.138623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:08.961 [2024-04-23 21:08:03.142322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.961 [2024-04-23 21:08:03.142323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:07:09.529 21:08:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:09.529 21:08:03 -- common/autotest_common.sh@850 -- # return 0 00:07:09.529 21:08:03 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:09.529 21:08:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.529 21:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:09.529 21:08:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:09.529 21:08:03 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:09.529 21:08:03 -- common/autotest_common.sh@638 -- # local es=0 00:07:09.529 21:08:03 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:09.529 21:08:03 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:07:09.529 21:08:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:09.529 21:08:03 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:07:09.529 21:08:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:09.529 21:08:03 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:09.529 21:08:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:09.529 21:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:09.529 [2024-04-23 21:08:03.726345] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1172969 has claimed it. 00:07:09.529 request: 00:07:09.529 { 00:07:09.529 "method": "framework_enable_cpumask_locks", 00:07:09.529 "req_id": 1 00:07:09.529 } 00:07:09.529 Got JSON-RPC error response 00:07:09.529 response: 00:07:09.529 { 00:07:09.529 "code": -32603, 00:07:09.529 "message": "Failed to claim CPU core: 2" 00:07:09.529 } 00:07:09.529 21:08:03 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:07:09.529 21:08:03 -- common/autotest_common.sh@641 -- # es=1 00:07:09.529 21:08:03 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:09.529 21:08:03 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:09.529 21:08:03 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:09.529 21:08:03 -- event/cpu_locks.sh@158 -- # waitforlisten 1172969 /var/tmp/spdk.sock 00:07:09.529 21:08:03 -- common/autotest_common.sh@817 -- # '[' -z 1172969 ']' 00:07:09.529 21:08:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:09.529 21:08:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:09.529 21:08:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:09.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:09.529 21:08:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:09.529 21:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:09.788 21:08:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:09.788 21:08:03 -- common/autotest_common.sh@850 -- # return 0 00:07:09.788 21:08:03 -- event/cpu_locks.sh@159 -- # waitforlisten 1173230 /var/tmp/spdk2.sock 00:07:09.788 21:08:03 -- common/autotest_common.sh@817 -- # '[' -z 1173230 ']' 00:07:09.788 21:08:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:09.788 21:08:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:09.788 21:08:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:09.788 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:09.788 21:08:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:09.788 21:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:10.047 21:08:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:10.047 21:08:04 -- common/autotest_common.sh@850 -- # return 0 00:07:10.047 21:08:04 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:10.047 21:08:04 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:10.047 21:08:04 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:10.047 21:08:04 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:10.047 00:07:10.047 real 0m1.990s 00:07:10.047 user 0m0.780s 00:07:10.047 sys 0m0.141s 00:07:10.047 21:08:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:10.047 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:10.047 ************************************ 00:07:10.047 END TEST locking_overlapped_coremask_via_rpc 00:07:10.047 ************************************ 00:07:10.047 21:08:04 -- event/cpu_locks.sh@174 -- # cleanup 00:07:10.047 21:08:04 -- event/cpu_locks.sh@15 -- # [[ -z 1172969 ]] 00:07:10.047 21:08:04 -- event/cpu_locks.sh@15 -- # killprocess 1172969 00:07:10.047 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 1172969 ']' 00:07:10.047 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 1172969 00:07:10.047 21:08:04 -- common/autotest_common.sh@941 -- # uname 00:07:10.047 21:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:10.047 21:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172969 00:07:10.047 21:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:10.047 21:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:10.047 21:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172969' 00:07:10.047 killing process with pid 1172969 00:07:10.047 21:08:04 -- common/autotest_common.sh@955 -- # kill 1172969 00:07:10.047 21:08:04 -- common/autotest_common.sh@960 -- # wait 1172969 00:07:10.306 21:08:04 -- event/cpu_locks.sh@16 -- # [[ -z 1173230 ]] 00:07:10.306 21:08:04 -- event/cpu_locks.sh@16 -- # killprocess 1173230 00:07:10.306 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 1173230 ']' 00:07:10.306 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 1173230 00:07:10.306 21:08:04 -- common/autotest_common.sh@941 -- # uname 00:07:10.306 21:08:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:10.306 21:08:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1173230 00:07:10.306 21:08:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:10.306 21:08:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:10.306 21:08:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1173230' 00:07:10.306 killing process with pid 1173230 00:07:10.306 21:08:04 -- common/autotest_common.sh@955 -- # kill 1173230 00:07:10.306 21:08:04 -- common/autotest_common.sh@960 -- # wait 1173230 00:07:10.876 21:08:04 -- event/cpu_locks.sh@18 -- # rm -f 00:07:10.876 21:08:04 -- event/cpu_locks.sh@1 -- # cleanup 00:07:10.876 21:08:04 -- event/cpu_locks.sh@15 -- # [[ -z 1172969 ]] 00:07:10.876 21:08:04 -- event/cpu_locks.sh@15 -- # killprocess 1172969 00:07:10.876 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 1172969 ']' 00:07:10.876 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 1172969 00:07:10.876 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1172969) - No such process 00:07:10.876 21:08:04 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1172969 is not found' 00:07:10.876 Process with pid 1172969 is not found 00:07:10.876 21:08:04 -- event/cpu_locks.sh@16 -- # [[ -z 1173230 ]] 00:07:10.876 21:08:04 -- event/cpu_locks.sh@16 -- # killprocess 1173230 00:07:10.876 21:08:04 -- common/autotest_common.sh@936 -- # '[' -z 1173230 ']' 00:07:10.876 21:08:04 -- common/autotest_common.sh@940 -- # kill -0 1173230 00:07:10.876 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1173230) - No such process 00:07:10.876 21:08:04 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1173230 is not found' 00:07:10.876 Process with pid 1173230 is not found 00:07:10.876 21:08:04 -- event/cpu_locks.sh@18 -- # rm -f 00:07:10.876 00:07:10.876 real 0m17.631s 00:07:10.876 user 0m28.919s 00:07:10.876 sys 0m5.056s 00:07:10.876 21:08:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:10.876 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:10.876 ************************************ 00:07:10.876 END TEST cpu_locks 00:07:10.876 ************************************ 00:07:10.876 00:07:10.876 real 0m43.134s 00:07:10.876 user 1m20.112s 00:07:10.876 sys 0m8.351s 00:07:10.876 21:08:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:10.876 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:10.876 ************************************ 00:07:10.876 END TEST event 00:07:10.876 ************************************ 00:07:10.876 21:08:04 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:07:10.876 21:08:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:10.876 21:08:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.876 21:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:10.876 ************************************ 00:07:10.876 START TEST thread 00:07:10.876 ************************************ 00:07:10.876 21:08:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:07:11.136 * Looking for test storage... 00:07:11.136 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:07:11.136 21:08:05 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:11.136 21:08:05 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:11.136 21:08:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.136 21:08:05 -- common/autotest_common.sh@10 -- # set +x 00:07:11.136 ************************************ 00:07:11.136 START TEST thread_poller_perf 00:07:11.136 ************************************ 00:07:11.136 21:08:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:11.136 [2024-04-23 21:08:05.290059] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:11.136 [2024-04-23 21:08:05.290104] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1173619 ] 00:07:11.136 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.136 [2024-04-23 21:08:05.339333] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.136 [2024-04-23 21:08:05.406153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.136 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:12.515 ====================================== 00:07:12.515 busy:2707891066 (cyc) 00:07:12.515 total_run_count: 456000 00:07:12.515 tsc_hz: 2700000000 (cyc) 00:07:12.516 ====================================== 00:07:12.516 poller_cost: 5938 (cyc), 2199 (nsec) 00:07:12.516 00:07:12.516 real 0m1.211s 00:07:12.516 user 0m1.142s 00:07:12.516 sys 0m0.065s 00:07:12.516 21:08:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:12.516 21:08:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.516 ************************************ 00:07:12.516 END TEST thread_poller_perf 00:07:12.516 ************************************ 00:07:12.516 21:08:06 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:12.516 21:08:06 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:12.516 21:08:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.516 21:08:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.516 ************************************ 00:07:12.516 START TEST thread_poller_perf 00:07:12.516 ************************************ 00:07:12.516 21:08:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:12.516 [2024-04-23 21:08:06.632393] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:12.516 [2024-04-23 21:08:06.632426] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1173907 ] 00:07:12.516 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.516 [2024-04-23 21:08:06.680502] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.516 [2024-04-23 21:08:06.745470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.516 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:13.895 ====================================== 00:07:13.895 busy:2701510916 (cyc) 00:07:13.895 total_run_count: 5934000 00:07:13.895 tsc_hz: 2700000000 (cyc) 00:07:13.895 ====================================== 00:07:13.895 poller_cost: 455 (cyc), 168 (nsec) 00:07:13.895 00:07:13.895 real 0m1.201s 00:07:13.895 user 0m1.140s 00:07:13.895 sys 0m0.057s 00:07:13.895 21:08:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.895 21:08:07 -- common/autotest_common.sh@10 -- # set +x 00:07:13.895 ************************************ 00:07:13.895 END TEST thread_poller_perf 00:07:13.895 ************************************ 00:07:13.895 21:08:07 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:13.895 00:07:13.895 real 0m2.779s 00:07:13.895 user 0m2.418s 00:07:13.895 sys 0m0.336s 00:07:13.895 21:08:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.895 21:08:07 -- common/autotest_common.sh@10 -- # set +x 00:07:13.895 ************************************ 00:07:13.895 END TEST thread 00:07:13.895 ************************************ 00:07:13.895 21:08:07 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:07:13.895 21:08:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:13.895 21:08:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.895 21:08:07 -- common/autotest_common.sh@10 -- # set +x 00:07:13.895 ************************************ 00:07:13.895 START TEST accel 00:07:13.895 ************************************ 00:07:13.895 21:08:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:07:13.895 * Looking for test storage... 00:07:13.895 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:07:13.895 21:08:08 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:07:13.895 21:08:08 -- accel/accel.sh@82 -- # get_expected_opcs 00:07:13.895 21:08:08 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:13.895 21:08:08 -- accel/accel.sh@62 -- # spdk_tgt_pid=1174233 00:07:13.895 21:08:08 -- accel/accel.sh@63 -- # waitforlisten 1174233 00:07:13.895 21:08:08 -- common/autotest_common.sh@817 -- # '[' -z 1174233 ']' 00:07:13.895 21:08:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:13.895 21:08:08 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:13.895 21:08:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:13.895 21:08:08 -- accel/accel.sh@61 -- # build_accel_config 00:07:13.895 21:08:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:13.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:13.895 21:08:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:13.895 21:08:08 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:13.895 21:08:08 -- common/autotest_common.sh@10 -- # set +x 00:07:13.895 21:08:08 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:13.895 21:08:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.895 21:08:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.895 21:08:08 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:13.895 21:08:08 -- accel/accel.sh@40 -- # local IFS=, 00:07:13.895 21:08:08 -- accel/accel.sh@41 -- # jq -r . 00:07:13.895 [2024-04-23 21:08:08.161368] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:13.895 [2024-04-23 21:08:08.161412] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1174233 ] 00:07:14.155 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.155 [2024-04-23 21:08:08.213843] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.155 [2024-04-23 21:08:08.285456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.724 21:08:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:14.724 21:08:08 -- common/autotest_common.sh@850 -- # return 0 00:07:14.724 21:08:08 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:07:14.724 21:08:08 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:07:14.724 21:08:08 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:07:14.724 21:08:08 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:07:14.724 21:08:08 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:14.724 21:08:08 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:07:14.724 21:08:08 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:14.724 21:08:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:14.724 21:08:08 -- common/autotest_common.sh@10 -- # set +x 00:07:14.724 21:08:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:14.724 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.724 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.724 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # IFS== 00:07:14.725 21:08:08 -- accel/accel.sh@72 -- # read -r opc module 00:07:14.725 21:08:08 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:14.725 21:08:08 -- accel/accel.sh@75 -- # killprocess 1174233 00:07:14.725 21:08:08 -- common/autotest_common.sh@936 -- # '[' -z 1174233 ']' 00:07:14.725 21:08:08 -- common/autotest_common.sh@940 -- # kill -0 1174233 00:07:14.725 21:08:08 -- common/autotest_common.sh@941 -- # uname 00:07:14.725 21:08:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:14.725 21:08:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1174233 00:07:14.984 21:08:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:14.984 21:08:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:14.984 21:08:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1174233' 00:07:14.984 killing process with pid 1174233 00:07:14.984 21:08:09 -- common/autotest_common.sh@955 -- # kill 1174233 00:07:14.984 21:08:09 -- common/autotest_common.sh@960 -- # wait 1174233 00:07:15.244 21:08:09 -- accel/accel.sh@76 -- # trap - ERR 00:07:15.244 21:08:09 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:07:15.244 21:08:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:15.244 21:08:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.244 21:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:15.244 21:08:09 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:07:15.244 21:08:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:15.244 21:08:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.244 21:08:09 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:15.244 21:08:09 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:15.244 21:08:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.244 21:08:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.244 21:08:09 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:15.244 21:08:09 -- accel/accel.sh@40 -- # local IFS=, 00:07:15.244 21:08:09 -- accel/accel.sh@41 -- # jq -r . 00:07:15.244 21:08:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:15.244 21:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:15.503 21:08:09 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:15.503 21:08:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:15.503 21:08:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.503 21:08:09 -- common/autotest_common.sh@10 -- # set +x 00:07:15.503 ************************************ 00:07:15.503 START TEST accel_missing_filename 00:07:15.503 ************************************ 00:07:15.503 21:08:09 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:07:15.503 21:08:09 -- common/autotest_common.sh@638 -- # local es=0 00:07:15.503 21:08:09 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:15.503 21:08:09 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:15.503 21:08:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:15.503 21:08:09 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:15.503 21:08:09 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:15.503 21:08:09 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:07:15.503 21:08:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:15.503 21:08:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.503 21:08:09 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:15.503 21:08:09 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:15.503 21:08:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.503 21:08:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.503 21:08:09 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:15.503 21:08:09 -- accel/accel.sh@40 -- # local IFS=, 00:07:15.503 21:08:09 -- accel/accel.sh@41 -- # jq -r . 00:07:15.503 [2024-04-23 21:08:09.706990] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:15.503 [2024-04-23 21:08:09.707061] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1174594 ] 00:07:15.503 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.503 [2024-04-23 21:08:09.760978] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.763 [2024-04-23 21:08:09.830034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.763 [2024-04-23 21:08:09.870147] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:15.763 [2024-04-23 21:08:09.929509] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:15.763 A filename is required. 00:07:15.763 21:08:10 -- common/autotest_common.sh@641 -- # es=234 00:07:15.763 21:08:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:15.763 21:08:10 -- common/autotest_common.sh@650 -- # es=106 00:07:15.763 21:08:10 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:15.763 21:08:10 -- common/autotest_common.sh@658 -- # es=1 00:07:15.763 21:08:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:15.763 00:07:15.763 real 0m0.336s 00:07:15.763 user 0m0.261s 00:07:15.763 sys 0m0.114s 00:07:15.763 21:08:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:15.763 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:15.763 ************************************ 00:07:15.763 END TEST accel_missing_filename 00:07:15.763 ************************************ 00:07:16.023 21:08:10 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:16.023 21:08:10 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:16.023 21:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.023 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.023 ************************************ 00:07:16.023 START TEST accel_compress_verify 00:07:16.023 ************************************ 00:07:16.023 21:08:10 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:16.023 21:08:10 -- common/autotest_common.sh@638 -- # local es=0 00:07:16.023 21:08:10 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:16.023 21:08:10 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:16.023 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.023 21:08:10 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:16.023 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.023 21:08:10 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:16.023 21:08:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:16.023 21:08:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.023 21:08:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:16.023 21:08:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:16.023 21:08:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.023 21:08:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.023 21:08:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:16.023 21:08:10 -- accel/accel.sh@40 -- # local IFS=, 00:07:16.023 21:08:10 -- accel/accel.sh@41 -- # jq -r . 00:07:16.023 [2024-04-23 21:08:10.214123] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:16.023 [2024-04-23 21:08:10.214190] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1174827 ] 00:07:16.023 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.023 [2024-04-23 21:08:10.270080] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.283 [2024-04-23 21:08:10.344711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.283 [2024-04-23 21:08:10.384745] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:16.283 [2024-04-23 21:08:10.444057] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:16.283 00:07:16.283 Compression does not support the verify option, aborting. 00:07:16.283 21:08:10 -- common/autotest_common.sh@641 -- # es=161 00:07:16.283 21:08:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:16.283 21:08:10 -- common/autotest_common.sh@650 -- # es=33 00:07:16.283 21:08:10 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:16.283 21:08:10 -- common/autotest_common.sh@658 -- # es=1 00:07:16.283 21:08:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:16.283 00:07:16.283 real 0m0.345s 00:07:16.283 user 0m0.263s 00:07:16.283 sys 0m0.120s 00:07:16.283 21:08:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:16.283 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.283 ************************************ 00:07:16.283 END TEST accel_compress_verify 00:07:16.283 ************************************ 00:07:16.543 21:08:10 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:16.543 21:08:10 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:16.543 21:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.543 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.543 ************************************ 00:07:16.543 START TEST accel_wrong_workload 00:07:16.543 ************************************ 00:07:16.543 21:08:10 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:07:16.543 21:08:10 -- common/autotest_common.sh@638 -- # local es=0 00:07:16.543 21:08:10 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:16.543 21:08:10 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:16.543 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.543 21:08:10 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:16.543 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.543 21:08:10 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:07:16.543 21:08:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:16.543 21:08:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.543 21:08:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:16.543 21:08:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:16.543 21:08:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.543 21:08:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.543 21:08:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:16.543 21:08:10 -- accel/accel.sh@40 -- # local IFS=, 00:07:16.543 21:08:10 -- accel/accel.sh@41 -- # jq -r . 00:07:16.543 Unsupported workload type: foobar 00:07:16.543 [2024-04-23 21:08:10.724416] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:16.543 accel_perf options: 00:07:16.543 [-h help message] 00:07:16.543 [-q queue depth per core] 00:07:16.543 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:16.543 [-T number of threads per core 00:07:16.543 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:16.543 [-t time in seconds] 00:07:16.543 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:16.543 [ dif_verify, , dif_generate, dif_generate_copy 00:07:16.543 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:16.543 [-l for compress/decompress workloads, name of uncompressed input file 00:07:16.543 [-S for crc32c workload, use this seed value (default 0) 00:07:16.543 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:16.543 [-f for fill workload, use this BYTE value (default 255) 00:07:16.543 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:16.543 [-y verify result if this switch is on] 00:07:16.543 [-a tasks to allocate per core (default: same value as -q)] 00:07:16.543 Can be used to spread operations across a wider range of memory. 00:07:16.543 21:08:10 -- common/autotest_common.sh@641 -- # es=1 00:07:16.543 21:08:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:16.543 21:08:10 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:16.543 21:08:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:16.543 00:07:16.543 real 0m0.033s 00:07:16.543 user 0m0.018s 00:07:16.543 sys 0m0.015s 00:07:16.543 21:08:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:16.543 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.543 ************************************ 00:07:16.543 END TEST accel_wrong_workload 00:07:16.543 ************************************ 00:07:16.543 Error: writing output failed: Broken pipe 00:07:16.543 21:08:10 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:16.543 21:08:10 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:16.543 21:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.543 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.802 ************************************ 00:07:16.802 START TEST accel_negative_buffers 00:07:16.802 ************************************ 00:07:16.802 21:08:10 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:16.802 21:08:10 -- common/autotest_common.sh@638 -- # local es=0 00:07:16.802 21:08:10 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:16.802 21:08:10 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:16.802 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.802 21:08:10 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:16.802 21:08:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:16.802 21:08:10 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:07:16.802 21:08:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:16.802 21:08:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.802 21:08:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:16.802 21:08:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:16.802 21:08:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.802 21:08:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.802 21:08:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:16.802 21:08:10 -- accel/accel.sh@40 -- # local IFS=, 00:07:16.802 21:08:10 -- accel/accel.sh@41 -- # jq -r . 00:07:16.802 -x option must be non-negative. 00:07:16.802 [2024-04-23 21:08:10.925509] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:16.802 accel_perf options: 00:07:16.802 [-h help message] 00:07:16.802 [-q queue depth per core] 00:07:16.802 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:16.802 [-T number of threads per core 00:07:16.802 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:16.802 [-t time in seconds] 00:07:16.802 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:16.802 [ dif_verify, , dif_generate, dif_generate_copy 00:07:16.802 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:16.802 [-l for compress/decompress workloads, name of uncompressed input file 00:07:16.802 [-S for crc32c workload, use this seed value (default 0) 00:07:16.802 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:16.802 [-f for fill workload, use this BYTE value (default 255) 00:07:16.802 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:16.802 [-y verify result if this switch is on] 00:07:16.802 [-a tasks to allocate per core (default: same value as -q)] 00:07:16.802 Can be used to spread operations across a wider range of memory. 00:07:16.802 21:08:10 -- common/autotest_common.sh@641 -- # es=1 00:07:16.802 21:08:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:16.802 21:08:10 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:16.802 21:08:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:16.802 00:07:16.802 real 0m0.031s 00:07:16.802 user 0m0.019s 00:07:16.802 sys 0m0.012s 00:07:16.802 21:08:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:16.802 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:16.802 ************************************ 00:07:16.802 END TEST accel_negative_buffers 00:07:16.802 ************************************ 00:07:16.802 Error: writing output failed: Broken pipe 00:07:16.803 21:08:10 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:16.803 21:08:10 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:16.803 21:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.803 21:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:17.062 ************************************ 00:07:17.062 START TEST accel_crc32c 00:07:17.062 ************************************ 00:07:17.062 21:08:11 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:17.062 21:08:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:17.062 21:08:11 -- accel/accel.sh@17 -- # local accel_module 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.062 21:08:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:17.062 21:08:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:17.062 21:08:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.062 21:08:11 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:17.062 21:08:11 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:17.062 21:08:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.062 21:08:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.062 21:08:11 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:17.062 21:08:11 -- accel/accel.sh@40 -- # local IFS=, 00:07:17.062 21:08:11 -- accel/accel.sh@41 -- # jq -r . 00:07:17.062 [2024-04-23 21:08:11.108588] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:17.062 [2024-04-23 21:08:11.108630] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1174953 ] 00:07:17.062 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.062 [2024-04-23 21:08:11.154563] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.062 [2024-04-23 21:08:11.221588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.062 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.062 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.062 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.062 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.062 21:08:11 -- accel/accel.sh@20 -- # val=0x1 00:07:17.062 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.062 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.062 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.062 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.062 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=crc32c 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=32 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=software 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@22 -- # accel_module=software 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=32 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=32 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=1 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val=Yes 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:17.063 21:08:11 -- accel/accel.sh@20 -- # val= 00:07:17.063 21:08:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # IFS=: 00:07:17.063 21:08:11 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.473 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:18.473 21:08:12 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:18.473 21:08:12 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.473 00:07:18.473 real 0m1.321s 00:07:18.473 user 0m1.240s 00:07:18.473 sys 0m0.095s 00:07:18.473 21:08:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:18.473 21:08:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.473 ************************************ 00:07:18.473 END TEST accel_crc32c 00:07:18.473 ************************************ 00:07:18.473 21:08:12 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:18.473 21:08:12 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:18.473 21:08:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.473 21:08:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.473 ************************************ 00:07:18.473 START TEST accel_crc32c_C2 00:07:18.473 ************************************ 00:07:18.473 21:08:12 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:18.473 21:08:12 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.473 21:08:12 -- accel/accel.sh@17 -- # local accel_module 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.473 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.473 21:08:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:18.473 21:08:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:18.473 21:08:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.473 21:08:12 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:18.473 21:08:12 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:18.473 21:08:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.473 21:08:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.473 21:08:12 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:18.473 21:08:12 -- accel/accel.sh@40 -- # local IFS=, 00:07:18.473 21:08:12 -- accel/accel.sh@41 -- # jq -r . 00:07:18.473 [2024-04-23 21:08:12.606640] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:18.473 [2024-04-23 21:08:12.606706] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1175284 ] 00:07:18.473 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.473 [2024-04-23 21:08:12.659969] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.473 [2024-04-23 21:08:12.726829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=0x1 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=crc32c 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=0 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=software 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@22 -- # accel_module=software 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=32 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=32 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=1 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val=Yes 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:18.745 21:08:12 -- accel/accel.sh@20 -- # val= 00:07:18.745 21:08:12 -- accel/accel.sh@21 -- # case "$var" in 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # IFS=: 00:07:18.745 21:08:12 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@20 -- # val= 00:07:19.685 21:08:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # IFS=: 00:07:19.685 21:08:13 -- accel/accel.sh@19 -- # read -r var val 00:07:19.685 21:08:13 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:19.685 21:08:13 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:19.685 21:08:13 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.685 00:07:19.685 real 0m1.339s 00:07:19.685 user 0m1.237s 00:07:19.685 sys 0m0.115s 00:07:19.685 21:08:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:19.686 21:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.686 ************************************ 00:07:19.686 END TEST accel_crc32c_C2 00:07:19.686 ************************************ 00:07:19.686 21:08:13 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:19.686 21:08:13 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:19.686 21:08:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.686 21:08:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.945 ************************************ 00:07:19.945 START TEST accel_copy 00:07:19.945 ************************************ 00:07:19.945 21:08:14 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:07:19.945 21:08:14 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.945 21:08:14 -- accel/accel.sh@17 -- # local accel_module 00:07:19.945 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:19.945 21:08:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:19.945 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:19.945 21:08:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:19.945 21:08:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.945 21:08:14 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:19.945 21:08:14 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:19.945 21:08:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.945 21:08:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.945 21:08:14 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:19.945 21:08:14 -- accel/accel.sh@40 -- # local IFS=, 00:07:19.945 21:08:14 -- accel/accel.sh@41 -- # jq -r . 00:07:19.945 [2024-04-23 21:08:14.074968] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:19.945 [2024-04-23 21:08:14.075013] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1175592 ] 00:07:19.945 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.945 [2024-04-23 21:08:14.126022] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.945 [2024-04-23 21:08:14.190979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=0x1 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=copy 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@23 -- # accel_opc=copy 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=software 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@22 -- # accel_module=software 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=32 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=32 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=1 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val=Yes 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:20.204 21:08:14 -- accel/accel.sh@20 -- # val= 00:07:20.204 21:08:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # IFS=: 00:07:20.204 21:08:14 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.142 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.142 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.142 21:08:15 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:21.142 21:08:15 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:07:21.142 21:08:15 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.142 00:07:21.142 real 0m1.328s 00:07:21.142 user 0m1.230s 00:07:21.142 sys 0m0.111s 00:07:21.142 21:08:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:21.142 21:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:21.142 ************************************ 00:07:21.142 END TEST accel_copy 00:07:21.142 ************************************ 00:07:21.142 21:08:15 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:21.142 21:08:15 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:21.142 21:08:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.142 21:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:21.401 ************************************ 00:07:21.402 START TEST accel_fill 00:07:21.402 ************************************ 00:07:21.402 21:08:15 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:21.402 21:08:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.402 21:08:15 -- accel/accel.sh@17 -- # local accel_module 00:07:21.402 21:08:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:21.402 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.402 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.402 21:08:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:21.402 21:08:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.402 21:08:15 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:21.402 21:08:15 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:21.402 21:08:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.402 21:08:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.402 21:08:15 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:21.402 21:08:15 -- accel/accel.sh@40 -- # local IFS=, 00:07:21.402 21:08:15 -- accel/accel.sh@41 -- # jq -r . 00:07:21.402 [2024-04-23 21:08:15.521486] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:21.402 [2024-04-23 21:08:15.521519] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1175887 ] 00:07:21.402 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.402 [2024-04-23 21:08:15.570253] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.402 [2024-04-23 21:08:15.634706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=0x1 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=fill 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@23 -- # accel_opc=fill 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=0x80 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=software 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@22 -- # accel_module=software 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=64 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=64 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=1 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val=Yes 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:21.661 21:08:15 -- accel/accel.sh@20 -- # val= 00:07:21.661 21:08:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # IFS=: 00:07:21.661 21:08:15 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@20 -- # val= 00:07:22.597 21:08:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.597 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.597 21:08:16 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:22.597 21:08:16 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:07:22.597 21:08:16 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.597 00:07:22.597 real 0m1.318s 00:07:22.597 user 0m1.236s 00:07:22.597 sys 0m0.096s 00:07:22.597 21:08:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:22.597 21:08:16 -- common/autotest_common.sh@10 -- # set +x 00:07:22.597 ************************************ 00:07:22.597 END TEST accel_fill 00:07:22.597 ************************************ 00:07:22.597 21:08:16 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:22.597 21:08:16 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:22.597 21:08:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.597 21:08:16 -- common/autotest_common.sh@10 -- # set +x 00:07:22.856 ************************************ 00:07:22.856 START TEST accel_copy_crc32c 00:07:22.856 ************************************ 00:07:22.856 21:08:16 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:07:22.856 21:08:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.856 21:08:16 -- accel/accel.sh@17 -- # local accel_module 00:07:22.856 21:08:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:22.856 21:08:16 -- accel/accel.sh@19 -- # IFS=: 00:07:22.856 21:08:16 -- accel/accel.sh@19 -- # read -r var val 00:07:22.856 21:08:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:22.856 21:08:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.856 21:08:16 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:22.856 21:08:16 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:22.856 21:08:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.856 21:08:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.856 21:08:16 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:22.856 21:08:16 -- accel/accel.sh@40 -- # local IFS=, 00:07:22.856 21:08:16 -- accel/accel.sh@41 -- # jq -r . 00:07:22.856 [2024-04-23 21:08:16.984155] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:22.856 [2024-04-23 21:08:16.984199] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1176192 ] 00:07:22.856 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.856 [2024-04-23 21:08:17.034003] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.856 [2024-04-23 21:08:17.099144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=0x1 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=0 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=software 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@22 -- # accel_module=software 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=32 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=32 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=1 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val=Yes 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:23.115 21:08:17 -- accel/accel.sh@20 -- # val= 00:07:23.115 21:08:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # IFS=: 00:07:23.115 21:08:17 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.053 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.053 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.053 21:08:18 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:24.053 21:08:18 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:24.053 21:08:18 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.053 00:07:24.053 real 0m1.320s 00:07:24.053 user 0m1.231s 00:07:24.053 sys 0m0.102s 00:07:24.053 21:08:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:24.053 21:08:18 -- common/autotest_common.sh@10 -- # set +x 00:07:24.053 ************************************ 00:07:24.053 END TEST accel_copy_crc32c 00:07:24.053 ************************************ 00:07:24.053 21:08:18 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:24.053 21:08:18 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:24.053 21:08:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.053 21:08:18 -- common/autotest_common.sh@10 -- # set +x 00:07:24.312 ************************************ 00:07:24.312 START TEST accel_copy_crc32c_C2 00:07:24.312 ************************************ 00:07:24.312 21:08:18 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:24.312 21:08:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.312 21:08:18 -- accel/accel.sh@17 -- # local accel_module 00:07:24.312 21:08:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:24.312 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.312 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.312 21:08:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:24.312 21:08:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.312 21:08:18 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:24.312 21:08:18 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:24.312 21:08:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.312 21:08:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.312 21:08:18 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:24.312 21:08:18 -- accel/accel.sh@40 -- # local IFS=, 00:07:24.312 21:08:18 -- accel/accel.sh@41 -- # jq -r . 00:07:24.312 [2024-04-23 21:08:18.442424] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:24.312 [2024-04-23 21:08:18.442469] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1176485 ] 00:07:24.312 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.312 [2024-04-23 21:08:18.492913] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.312 [2024-04-23 21:08:18.557674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=0x1 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=0 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val='8192 bytes' 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=software 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@22 -- # accel_module=software 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=32 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=32 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=1 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val=Yes 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:24.571 21:08:18 -- accel/accel.sh@20 -- # val= 00:07:24.571 21:08:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # IFS=: 00:07:24.571 21:08:18 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@20 -- # val= 00:07:25.506 21:08:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.506 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.506 21:08:19 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:25.506 21:08:19 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:25.506 21:08:19 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.506 00:07:25.506 real 0m1.321s 00:07:25.506 user 0m1.226s 00:07:25.506 sys 0m0.108s 00:07:25.506 21:08:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.506 21:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.506 ************************************ 00:07:25.506 END TEST accel_copy_crc32c_C2 00:07:25.506 ************************************ 00:07:25.769 21:08:19 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:25.769 21:08:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:25.769 21:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.769 21:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.769 ************************************ 00:07:25.769 START TEST accel_dualcast 00:07:25.769 ************************************ 00:07:25.769 21:08:19 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:07:25.769 21:08:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.769 21:08:19 -- accel/accel.sh@17 -- # local accel_module 00:07:25.769 21:08:19 -- accel/accel.sh@19 -- # IFS=: 00:07:25.769 21:08:19 -- accel/accel.sh@19 -- # read -r var val 00:07:25.769 21:08:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:25.769 21:08:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:25.769 21:08:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.769 21:08:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:25.769 21:08:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:25.769 21:08:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.769 21:08:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.769 21:08:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:25.769 21:08:19 -- accel/accel.sh@40 -- # local IFS=, 00:07:25.769 21:08:19 -- accel/accel.sh@41 -- # jq -r . 00:07:25.769 [2024-04-23 21:08:19.920205] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:25.769 [2024-04-23 21:08:19.920270] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1176786 ] 00:07:25.769 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.769 [2024-04-23 21:08:19.971850] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.028 [2024-04-23 21:08:20.044817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val=0x1 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val=dualcast 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.028 21:08:20 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:26.028 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.028 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val=software 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@22 -- # accel_module=software 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val=32 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val=32 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val=1 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val=Yes 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.029 21:08:20 -- accel/accel.sh@20 -- # val= 00:07:26.029 21:08:20 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # IFS=: 00:07:26.029 21:08:20 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:26.965 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:26.965 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:26.965 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.224 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.224 21:08:21 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:27.224 21:08:21 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:07:27.224 21:08:21 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.224 00:07:27.224 real 0m1.343s 00:07:27.224 user 0m1.234s 00:07:27.224 sys 0m0.122s 00:07:27.224 21:08:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:27.224 21:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:27.224 ************************************ 00:07:27.224 END TEST accel_dualcast 00:07:27.224 ************************************ 00:07:27.224 21:08:21 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:27.224 21:08:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:27.224 21:08:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.224 21:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:27.224 ************************************ 00:07:27.224 START TEST accel_compare 00:07:27.224 ************************************ 00:07:27.224 21:08:21 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:07:27.224 21:08:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.224 21:08:21 -- accel/accel.sh@17 -- # local accel_module 00:07:27.224 21:08:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:27.224 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.224 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.224 21:08:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:27.224 21:08:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.224 21:08:21 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:27.224 21:08:21 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:27.224 21:08:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.224 21:08:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.224 21:08:21 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:27.224 21:08:21 -- accel/accel.sh@40 -- # local IFS=, 00:07:27.224 21:08:21 -- accel/accel.sh@41 -- # jq -r . 00:07:27.224 [2024-04-23 21:08:21.411675] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:27.224 [2024-04-23 21:08:21.411718] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1177114 ] 00:07:27.224 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.224 [2024-04-23 21:08:21.459356] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.484 [2024-04-23 21:08:21.530874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=0x1 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=compare 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@23 -- # accel_opc=compare 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=software 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@22 -- # accel_module=software 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=32 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=32 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=1 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val=Yes 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:27.484 21:08:21 -- accel/accel.sh@20 -- # val= 00:07:27.484 21:08:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # IFS=: 00:07:27.484 21:08:21 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:22 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:28.861 21:08:22 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:07:28.861 21:08:22 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.861 00:07:28.861 real 0m1.326s 00:07:28.861 user 0m1.231s 00:07:28.861 sys 0m0.106s 00:07:28.861 21:08:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:28.861 21:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:28.861 ************************************ 00:07:28.861 END TEST accel_compare 00:07:28.861 ************************************ 00:07:28.861 21:08:22 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:28.861 21:08:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:28.861 21:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.861 21:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:28.861 ************************************ 00:07:28.861 START TEST accel_xor 00:07:28.861 ************************************ 00:07:28.861 21:08:22 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:07:28.861 21:08:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.861 21:08:22 -- accel/accel.sh@17 -- # local accel_module 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:22 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:28.861 21:08:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.861 21:08:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:28.861 21:08:22 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:28.861 21:08:22 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:28.861 21:08:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.861 21:08:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.861 21:08:22 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:28.861 21:08:22 -- accel/accel.sh@40 -- # local IFS=, 00:07:28.861 21:08:22 -- accel/accel.sh@41 -- # jq -r . 00:07:28.861 [2024-04-23 21:08:22.862038] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:28.861 [2024-04-23 21:08:22.862103] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1177454 ] 00:07:28.861 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.861 [2024-04-23 21:08:22.914924] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.861 [2024-04-23 21:08:22.978406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=0x1 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=xor 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=2 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=software 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@22 -- # accel_module=software 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=32 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=32 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=1 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val=Yes 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:28.861 21:08:23 -- accel/accel.sh@20 -- # val= 00:07:28.861 21:08:23 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # IFS=: 00:07:28.861 21:08:23 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.240 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:30.240 21:08:24 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:30.240 21:08:24 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.240 00:07:30.240 real 0m1.335s 00:07:30.240 user 0m1.234s 00:07:30.240 sys 0m0.114s 00:07:30.240 21:08:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:30.240 21:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:30.240 ************************************ 00:07:30.240 END TEST accel_xor 00:07:30.240 ************************************ 00:07:30.240 21:08:24 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:30.240 21:08:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:30.240 21:08:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.240 21:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:30.240 ************************************ 00:07:30.240 START TEST accel_xor 00:07:30.240 ************************************ 00:07:30.240 21:08:24 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:07:30.240 21:08:24 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.240 21:08:24 -- accel/accel.sh@17 -- # local accel_module 00:07:30.240 21:08:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.240 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.240 21:08:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:30.240 21:08:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.241 21:08:24 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:30.241 21:08:24 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:30.241 21:08:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.241 21:08:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.241 21:08:24 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:30.241 21:08:24 -- accel/accel.sh@40 -- # local IFS=, 00:07:30.241 21:08:24 -- accel/accel.sh@41 -- # jq -r . 00:07:30.241 [2024-04-23 21:08:24.327252] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:30.241 [2024-04-23 21:08:24.327387] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1177768 ] 00:07:30.241 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.241 [2024-04-23 21:08:24.372758] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.241 [2024-04-23 21:08:24.437687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=0x1 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=xor 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=3 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=software 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@22 -- # accel_module=software 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=32 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=32 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=1 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val=Yes 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:30.241 21:08:24 -- accel/accel.sh@20 -- # val= 00:07:30.241 21:08:24 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # IFS=: 00:07:30.241 21:08:24 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.619 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:31.619 21:08:25 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:31.619 21:08:25 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.619 00:07:31.619 real 0m1.316s 00:07:31.619 user 0m1.234s 00:07:31.619 sys 0m0.096s 00:07:31.619 21:08:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:31.619 21:08:25 -- common/autotest_common.sh@10 -- # set +x 00:07:31.619 ************************************ 00:07:31.619 END TEST accel_xor 00:07:31.619 ************************************ 00:07:31.619 21:08:25 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:31.619 21:08:25 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:31.619 21:08:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.619 21:08:25 -- common/autotest_common.sh@10 -- # set +x 00:07:31.619 ************************************ 00:07:31.619 START TEST accel_dif_verify 00:07:31.619 ************************************ 00:07:31.619 21:08:25 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:07:31.619 21:08:25 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.619 21:08:25 -- accel/accel.sh@17 -- # local accel_module 00:07:31.619 21:08:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.619 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.619 21:08:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:31.619 21:08:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.619 21:08:25 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:31.619 21:08:25 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:31.619 21:08:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.619 21:08:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.619 21:08:25 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:31.619 21:08:25 -- accel/accel.sh@40 -- # local IFS=, 00:07:31.619 21:08:25 -- accel/accel.sh@41 -- # jq -r . 00:07:31.619 [2024-04-23 21:08:25.763437] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:31.619 [2024-04-23 21:08:25.763471] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1178051 ] 00:07:31.619 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.619 [2024-04-23 21:08:25.806922] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.619 [2024-04-23 21:08:25.871480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val=0x1 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val=dif_verify 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.878 21:08:25 -- accel/accel.sh@20 -- # val=software 00:07:31.878 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.878 21:08:25 -- accel/accel.sh@22 -- # accel_module=software 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.878 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val=32 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val=32 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val=1 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val=No 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:31.879 21:08:25 -- accel/accel.sh@20 -- # val= 00:07:31.879 21:08:25 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # IFS=: 00:07:31.879 21:08:25 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:32.816 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:32.816 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:32.816 21:08:27 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:32.816 21:08:27 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:07:32.816 21:08:27 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.816 00:07:32.816 real 0m1.314s 00:07:32.816 user 0m1.226s 00:07:32.816 sys 0m0.101s 00:07:32.816 21:08:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:32.816 21:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:32.816 ************************************ 00:07:32.816 END TEST accel_dif_verify 00:07:32.816 ************************************ 00:07:33.076 21:08:27 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:33.076 21:08:27 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:33.076 21:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.076 21:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:33.076 ************************************ 00:07:33.076 START TEST accel_dif_generate 00:07:33.076 ************************************ 00:07:33.076 21:08:27 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:07:33.076 21:08:27 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.076 21:08:27 -- accel/accel.sh@17 -- # local accel_module 00:07:33.076 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.076 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.076 21:08:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:33.076 21:08:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.076 21:08:27 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:33.076 21:08:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:33.076 21:08:27 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:33.076 21:08:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.076 21:08:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.076 21:08:27 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:33.076 21:08:27 -- accel/accel.sh@40 -- # local IFS=, 00:07:33.076 21:08:27 -- accel/accel.sh@41 -- # jq -r . 00:07:33.076 [2024-04-23 21:08:27.222573] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:33.076 [2024-04-23 21:08:27.222621] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1178343 ] 00:07:33.076 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.076 [2024-04-23 21:08:27.273088] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.076 [2024-04-23 21:08:27.337308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=0x1 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=dif_generate 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=software 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@22 -- # accel_module=software 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=32 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=32 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=1 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val=No 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:33.335 21:08:27 -- accel/accel.sh@20 -- # val= 00:07:33.335 21:08:27 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # IFS=: 00:07:33.335 21:08:27 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.307 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.307 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.307 21:08:28 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:34.307 21:08:28 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:07:34.307 21:08:28 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:34.307 00:07:34.307 real 0m1.332s 00:07:34.307 user 0m1.246s 00:07:34.307 sys 0m0.101s 00:07:34.307 21:08:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:34.307 21:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:34.307 ************************************ 00:07:34.307 END TEST accel_dif_generate 00:07:34.307 ************************************ 00:07:34.307 21:08:28 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:34.307 21:08:28 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:34.307 21:08:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.307 21:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:34.566 ************************************ 00:07:34.566 START TEST accel_dif_generate_copy 00:07:34.566 ************************************ 00:07:34.566 21:08:28 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:07:34.566 21:08:28 -- accel/accel.sh@16 -- # local accel_opc 00:07:34.566 21:08:28 -- accel/accel.sh@17 -- # local accel_module 00:07:34.566 21:08:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:34.566 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.566 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.566 21:08:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:34.566 21:08:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.566 21:08:28 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:34.566 21:08:28 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:34.566 21:08:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.566 21:08:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.566 21:08:28 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:34.566 21:08:28 -- accel/accel.sh@40 -- # local IFS=, 00:07:34.566 21:08:28 -- accel/accel.sh@41 -- # jq -r . 00:07:34.567 [2024-04-23 21:08:28.698041] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:34.567 [2024-04-23 21:08:28.698081] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1178632 ] 00:07:34.567 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.567 [2024-04-23 21:08:28.748196] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.567 [2024-04-23 21:08:28.817180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=0x1 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=software 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@22 -- # accel_module=software 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=32 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=32 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=1 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val=No 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:34.826 21:08:28 -- accel/accel.sh@20 -- # val= 00:07:34.826 21:08:28 -- accel/accel.sh@21 -- # case "$var" in 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # IFS=: 00:07:34.826 21:08:28 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:35.763 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:35.763 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:35.763 21:08:30 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:35.763 21:08:30 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:07:35.763 21:08:30 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.763 00:07:35.763 real 0m1.323s 00:07:35.763 user 0m1.231s 00:07:35.763 sys 0m0.104s 00:07:35.763 21:08:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:35.763 21:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:35.763 ************************************ 00:07:35.763 END TEST accel_dif_generate_copy 00:07:35.763 ************************************ 00:07:36.023 21:08:30 -- accel/accel.sh@115 -- # [[ y == y ]] 00:07:36.023 21:08:30 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:36.023 21:08:30 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:36.023 21:08:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.023 21:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:36.023 ************************************ 00:07:36.023 START TEST accel_comp 00:07:36.023 ************************************ 00:07:36.023 21:08:30 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:36.023 21:08:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.023 21:08:30 -- accel/accel.sh@17 -- # local accel_module 00:07:36.023 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.023 21:08:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:36.023 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.023 21:08:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:36.023 21:08:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.023 21:08:30 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:36.023 21:08:30 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:36.023 21:08:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.023 21:08:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.023 21:08:30 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:36.023 21:08:30 -- accel/accel.sh@40 -- # local IFS=, 00:07:36.023 21:08:30 -- accel/accel.sh@41 -- # jq -r . 00:07:36.023 [2024-04-23 21:08:30.190712] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:36.023 [2024-04-23 21:08:30.190760] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1178923 ] 00:07:36.023 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.023 [2024-04-23 21:08:30.245038] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.283 [2024-04-23 21:08:30.316310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=0x1 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=compress 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@23 -- # accel_opc=compress 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=software 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@22 -- # accel_module=software 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=32 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.283 21:08:30 -- accel/accel.sh@20 -- # val=32 00:07:36.283 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.283 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.284 21:08:30 -- accel/accel.sh@20 -- # val=1 00:07:36.284 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.284 21:08:30 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:36.284 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.284 21:08:30 -- accel/accel.sh@20 -- # val=No 00:07:36.284 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.284 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.284 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:36.284 21:08:30 -- accel/accel.sh@20 -- # val= 00:07:36.284 21:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:36.284 21:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.662 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.662 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.662 21:08:31 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:37.663 21:08:31 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:07:37.663 21:08:31 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:37.663 00:07:37.663 real 0m1.346s 00:07:37.663 user 0m1.252s 00:07:37.663 sys 0m0.107s 00:07:37.663 21:08:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:37.663 21:08:31 -- common/autotest_common.sh@10 -- # set +x 00:07:37.663 ************************************ 00:07:37.663 END TEST accel_comp 00:07:37.663 ************************************ 00:07:37.663 21:08:31 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:37.663 21:08:31 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:37.663 21:08:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.663 21:08:31 -- common/autotest_common.sh@10 -- # set +x 00:07:37.663 ************************************ 00:07:37.663 START TEST accel_decomp 00:07:37.663 ************************************ 00:07:37.663 21:08:31 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:37.663 21:08:31 -- accel/accel.sh@16 -- # local accel_opc 00:07:37.663 21:08:31 -- accel/accel.sh@17 -- # local accel_module 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:37.663 21:08:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.663 21:08:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:37.663 21:08:31 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:37.663 21:08:31 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:37.663 21:08:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.663 21:08:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.663 21:08:31 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:37.663 21:08:31 -- accel/accel.sh@40 -- # local IFS=, 00:07:37.663 21:08:31 -- accel/accel.sh@41 -- # jq -r . 00:07:37.663 [2024-04-23 21:08:31.680914] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:37.663 [2024-04-23 21:08:31.680968] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1179210 ] 00:07:37.663 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.663 [2024-04-23 21:08:31.732256] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.663 [2024-04-23 21:08:31.797177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=0x1 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=decompress 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=software 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@22 -- # accel_module=software 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=32 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=32 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=1 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val=Yes 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:37.663 21:08:31 -- accel/accel.sh@20 -- # val= 00:07:37.663 21:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:37.663 21:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@20 -- # val= 00:07:39.041 21:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:39.041 21:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:39.041 21:08:32 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:39.041 21:08:32 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:39.041 21:08:32 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:39.041 00:07:39.041 real 0m1.334s 00:07:39.041 user 0m1.241s 00:07:39.041 sys 0m0.106s 00:07:39.041 21:08:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:39.041 21:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:39.041 ************************************ 00:07:39.041 END TEST accel_decomp 00:07:39.041 ************************************ 00:07:39.042 21:08:33 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.042 21:08:33 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:39.042 21:08:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.042 21:08:33 -- common/autotest_common.sh@10 -- # set +x 00:07:39.042 ************************************ 00:07:39.042 START TEST accel_decmop_full 00:07:39.042 ************************************ 00:07:39.042 21:08:33 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.042 21:08:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.042 21:08:33 -- accel/accel.sh@17 -- # local accel_module 00:07:39.042 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.042 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.042 21:08:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.042 21:08:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.042 21:08:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.042 21:08:33 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:39.042 21:08:33 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:39.042 21:08:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.042 21:08:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.042 21:08:33 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:39.042 21:08:33 -- accel/accel.sh@40 -- # local IFS=, 00:07:39.042 21:08:33 -- accel/accel.sh@41 -- # jq -r . 00:07:39.042 [2024-04-23 21:08:33.156100] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:39.042 [2024-04-23 21:08:33.156147] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1179501 ] 00:07:39.042 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.042 [2024-04-23 21:08:33.207177] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.042 [2024-04-23 21:08:33.273982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=0x1 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=decompress 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=software 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@22 -- # accel_module=software 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=32 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=32 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=1 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val=Yes 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:39.301 21:08:33 -- accel/accel.sh@20 -- # val= 00:07:39.301 21:08:33 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # IFS=: 00:07:39.301 21:08:33 -- accel/accel.sh@19 -- # read -r var val 00:07:40.238 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.238 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.238 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.238 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.238 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.238 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.238 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.238 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.238 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.239 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.239 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.239 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.239 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.239 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.239 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.239 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.239 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.239 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.239 21:08:34 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:40.239 21:08:34 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:40.239 21:08:34 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:40.239 00:07:40.239 real 0m1.344s 00:07:40.239 user 0m1.249s 00:07:40.239 sys 0m0.107s 00:07:40.239 21:08:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:40.239 21:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:40.239 ************************************ 00:07:40.239 END TEST accel_decmop_full 00:07:40.239 ************************************ 00:07:40.239 21:08:34 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:40.239 21:08:34 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:40.239 21:08:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.239 21:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:40.498 ************************************ 00:07:40.498 START TEST accel_decomp_mcore 00:07:40.498 ************************************ 00:07:40.498 21:08:34 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:40.498 21:08:34 -- accel/accel.sh@16 -- # local accel_opc 00:07:40.498 21:08:34 -- accel/accel.sh@17 -- # local accel_module 00:07:40.498 21:08:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:40.498 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.498 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.498 21:08:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:40.498 21:08:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.498 21:08:34 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:40.498 21:08:34 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:40.498 21:08:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.498 21:08:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.498 21:08:34 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:40.498 21:08:34 -- accel/accel.sh@40 -- # local IFS=, 00:07:40.498 21:08:34 -- accel/accel.sh@41 -- # jq -r . 00:07:40.498 [2024-04-23 21:08:34.624807] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:40.498 [2024-04-23 21:08:34.624848] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1179789 ] 00:07:40.498 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.498 [2024-04-23 21:08:34.672792] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.498 [2024-04-23 21:08:34.738460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.498 [2024-04-23 21:08:34.738557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.498 [2024-04-23 21:08:34.738633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.498 [2024-04-23 21:08:34.738634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=0xf 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=decompress 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=software 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@22 -- # accel_module=software 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=32 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=32 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=1 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val=Yes 00:07:40.757 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.757 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.757 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.758 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.758 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.758 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:40.758 21:08:34 -- accel/accel.sh@20 -- # val= 00:07:40.758 21:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.758 21:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:40.758 21:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@20 -- # val= 00:07:41.693 21:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:41.693 21:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:41.693 21:08:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:41.693 21:08:35 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:41.693 21:08:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.693 00:07:41.693 real 0m1.328s 00:07:41.693 user 0m4.546s 00:07:41.693 sys 0m0.115s 00:07:41.693 21:08:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:41.693 21:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:41.693 ************************************ 00:07:41.693 END TEST accel_decomp_mcore 00:07:41.693 ************************************ 00:07:41.953 21:08:35 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:41.953 21:08:35 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:41.953 21:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.953 21:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:41.953 ************************************ 00:07:41.953 START TEST accel_decomp_full_mcore 00:07:41.953 ************************************ 00:07:41.953 21:08:36 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:41.953 21:08:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.953 21:08:36 -- accel/accel.sh@17 -- # local accel_module 00:07:41.953 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:41.953 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:41.953 21:08:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:41.953 21:08:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:41.953 21:08:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.953 21:08:36 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:41.953 21:08:36 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:41.953 21:08:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.953 21:08:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.953 21:08:36 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:41.953 21:08:36 -- accel/accel.sh@40 -- # local IFS=, 00:07:41.953 21:08:36 -- accel/accel.sh@41 -- # jq -r . 00:07:41.953 [2024-04-23 21:08:36.092903] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:41.953 [2024-04-23 21:08:36.092948] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1180086 ] 00:07:41.953 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.953 [2024-04-23 21:08:36.143962] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:41.953 [2024-04-23 21:08:36.210490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:41.953 [2024-04-23 21:08:36.210586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:41.953 [2024-04-23 21:08:36.210646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:41.953 [2024-04-23 21:08:36.210648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val=0xf 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val=decompress 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.211 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.211 21:08:36 -- accel/accel.sh@20 -- # val=software 00:07:42.211 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@22 -- # accel_module=software 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val=32 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val=32 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val=1 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val=Yes 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:42.212 21:08:36 -- accel/accel.sh@20 -- # val= 00:07:42.212 21:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:42.212 21:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.147 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.147 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.147 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.406 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.406 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.406 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.406 21:08:37 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:43.406 21:08:37 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:43.406 21:08:37 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:43.406 00:07:43.406 real 0m1.352s 00:07:43.406 user 0m4.588s 00:07:43.406 sys 0m0.121s 00:07:43.406 21:08:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:43.406 21:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:43.406 ************************************ 00:07:43.406 END TEST accel_decomp_full_mcore 00:07:43.406 ************************************ 00:07:43.406 21:08:37 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.406 21:08:37 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:43.406 21:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.406 21:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:43.406 ************************************ 00:07:43.406 START TEST accel_decomp_mthread 00:07:43.406 ************************************ 00:07:43.406 21:08:37 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.406 21:08:37 -- accel/accel.sh@16 -- # local accel_opc 00:07:43.406 21:08:37 -- accel/accel.sh@17 -- # local accel_module 00:07:43.406 21:08:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.406 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.406 21:08:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.406 21:08:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.406 21:08:37 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:43.406 21:08:37 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:43.406 21:08:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.406 21:08:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.406 21:08:37 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:43.406 21:08:37 -- accel/accel.sh@40 -- # local IFS=, 00:07:43.406 21:08:37 -- accel/accel.sh@41 -- # jq -r . 00:07:43.406 [2024-04-23 21:08:37.566794] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:43.406 [2024-04-23 21:08:37.566834] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1180374 ] 00:07:43.406 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.406 [2024-04-23 21:08:37.614570] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.666 [2024-04-23 21:08:37.679380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=0x1 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=decompress 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=software 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@22 -- # accel_module=software 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=32 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=32 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=2 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val=Yes 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:43.666 21:08:37 -- accel/accel.sh@20 -- # val= 00:07:43.666 21:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:43.666 21:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.602 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.602 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.602 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.602 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.602 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.602 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.602 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.861 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.861 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.861 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.861 21:08:38 -- accel/accel.sh@20 -- # val= 00:07:44.861 21:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.861 21:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:44.861 21:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:44.861 21:08:38 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:44.861 21:08:38 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:44.861 21:08:38 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.861 00:07:44.861 real 0m1.322s 00:07:44.861 user 0m1.237s 00:07:44.861 sys 0m0.098s 00:07:44.861 21:08:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:44.861 21:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:44.861 ************************************ 00:07:44.861 END TEST accel_decomp_mthread 00:07:44.861 ************************************ 00:07:44.861 21:08:38 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.861 21:08:38 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:44.861 21:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.861 21:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:44.861 ************************************ 00:07:44.861 START TEST accel_deomp_full_mthread 00:07:44.861 ************************************ 00:07:44.861 21:08:39 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.861 21:08:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.861 21:08:39 -- accel/accel.sh@17 -- # local accel_module 00:07:44.861 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:44.861 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:44.861 21:08:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.861 21:08:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.861 21:08:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.861 21:08:39 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:44.861 21:08:39 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:44.861 21:08:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.861 21:08:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.861 21:08:39 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:44.861 21:08:39 -- accel/accel.sh@40 -- # local IFS=, 00:07:44.861 21:08:39 -- accel/accel.sh@41 -- # jq -r . 00:07:44.861 [2024-04-23 21:08:39.069696] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:44.861 [2024-04-23 21:08:39.069761] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1180666 ] 00:07:44.861 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.861 [2024-04-23 21:08:39.124094] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.121 [2024-04-23 21:08:39.196075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=0x1 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=decompress 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=software 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@22 -- # accel_module=software 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=32 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=32 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=2 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val=Yes 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:45.121 21:08:39 -- accel/accel.sh@20 -- # val= 00:07:45.121 21:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:45.121 21:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@20 -- # val= 00:07:46.498 21:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:46.498 21:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:46.498 21:08:40 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:46.498 21:08:40 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:46.498 21:08:40 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.498 00:07:46.498 real 0m1.369s 00:07:46.498 user 0m1.260s 00:07:46.498 sys 0m0.121s 00:07:46.498 21:08:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:46.498 21:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:46.498 ************************************ 00:07:46.498 END TEST accel_deomp_full_mthread 00:07:46.498 ************************************ 00:07:46.498 21:08:40 -- accel/accel.sh@124 -- # [[ n == y ]] 00:07:46.498 21:08:40 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:46.498 21:08:40 -- accel/accel.sh@137 -- # build_accel_config 00:07:46.498 21:08:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:46.498 21:08:40 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:46.498 21:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.498 21:08:40 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:46.498 21:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:46.498 21:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.498 21:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.498 21:08:40 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:46.498 21:08:40 -- accel/accel.sh@40 -- # local IFS=, 00:07:46.498 21:08:40 -- accel/accel.sh@41 -- # jq -r . 00:07:46.498 ************************************ 00:07:46.498 START TEST accel_dif_functional_tests 00:07:46.498 ************************************ 00:07:46.498 21:08:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:46.498 [2024-04-23 21:08:40.570591] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:46.498 [2024-04-23 21:08:40.570624] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1180953 ] 00:07:46.498 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.498 [2024-04-23 21:08:40.617640] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:46.498 [2024-04-23 21:08:40.682619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.498 [2024-04-23 21:08:40.682714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.498 [2024-04-23 21:08:40.682715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.498 00:07:46.498 00:07:46.498 CUnit - A unit testing framework for C - Version 2.1-3 00:07:46.498 http://cunit.sourceforge.net/ 00:07:46.498 00:07:46.498 00:07:46.498 Suite: accel_dif 00:07:46.498 Test: verify: DIF generated, GUARD check ...passed 00:07:46.498 Test: verify: DIF generated, APPTAG check ...passed 00:07:46.498 Test: verify: DIF generated, REFTAG check ...passed 00:07:46.498 Test: verify: DIF not generated, GUARD check ...[2024-04-23 21:08:40.749062] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:46.498 [2024-04-23 21:08:40.749100] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:46.498 passed 00:07:46.498 Test: verify: DIF not generated, APPTAG check ...[2024-04-23 21:08:40.749125] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:46.498 [2024-04-23 21:08:40.749137] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:46.498 passed 00:07:46.498 Test: verify: DIF not generated, REFTAG check ...[2024-04-23 21:08:40.749152] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:46.498 [2024-04-23 21:08:40.749165] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:46.498 passed 00:07:46.498 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:46.498 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-23 21:08:40.749203] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:46.498 passed 00:07:46.498 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:46.498 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:46.498 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:46.498 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-23 21:08:40.749301] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:46.498 passed 00:07:46.498 Test: generate copy: DIF generated, GUARD check ...passed 00:07:46.498 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:46.498 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:46.498 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:46.498 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:46.498 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:46.498 Test: generate copy: iovecs-len validate ...[2024-04-23 21:08:40.749452] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:46.498 passed 00:07:46.498 Test: generate copy: buffer alignment validate ...passed 00:07:46.498 00:07:46.498 Run Summary: Type Total Ran Passed Failed Inactive 00:07:46.498 suites 1 1 n/a 0 0 00:07:46.498 tests 20 20 20 0 0 00:07:46.499 asserts 204 204 204 0 n/a 00:07:46.499 00:07:46.499 Elapsed time = 0.002 seconds 00:07:46.757 00:07:46.757 real 0m0.397s 00:07:46.757 user 0m0.575s 00:07:46.757 sys 0m0.133s 00:07:46.758 21:08:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:46.758 21:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:46.758 ************************************ 00:07:46.758 END TEST accel_dif_functional_tests 00:07:46.758 ************************************ 00:07:46.758 00:07:46.758 real 0m32.933s 00:07:46.758 user 0m35.478s 00:07:46.758 sys 0m5.004s 00:07:46.758 21:08:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:46.758 21:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:46.758 ************************************ 00:07:46.758 END TEST accel 00:07:46.758 ************************************ 00:07:46.758 21:08:40 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:46.758 21:08:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:46.758 21:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.758 21:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:47.016 ************************************ 00:07:47.016 START TEST accel_rpc 00:07:47.016 ************************************ 00:07:47.016 21:08:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:47.016 * Looking for test storage... 00:07:47.016 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:07:47.016 21:08:41 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:47.016 21:08:41 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1181144 00:07:47.016 21:08:41 -- accel/accel_rpc.sh@15 -- # waitforlisten 1181144 00:07:47.016 21:08:41 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:47.016 21:08:41 -- common/autotest_common.sh@817 -- # '[' -z 1181144 ']' 00:07:47.016 21:08:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.016 21:08:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:47.016 21:08:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.016 21:08:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:47.016 21:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:47.016 [2024-04-23 21:08:41.274005] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:47.016 [2024-04-23 21:08:41.274049] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1181144 ] 00:07:47.275 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.275 [2024-04-23 21:08:41.324138] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.275 [2024-04-23 21:08:41.394545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.842 21:08:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:47.842 21:08:42 -- common/autotest_common.sh@850 -- # return 0 00:07:47.842 21:08:42 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:47.842 21:08:42 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:47.842 21:08:42 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:47.842 21:08:42 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:47.842 21:08:42 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:47.842 21:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:47.842 21:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.842 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 ************************************ 00:07:48.101 START TEST accel_assign_opcode 00:07:48.101 ************************************ 00:07:48.101 21:08:42 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:48.101 21:08:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:48.101 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 [2024-04-23 21:08:42.120608] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:48.101 21:08:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:48.101 21:08:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:48.101 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 [2024-04-23 21:08:42.128618] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:48.101 21:08:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:48.101 21:08:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:48.101 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 21:08:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@42 -- # grep software 00:07:48.101 21:08:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:48.101 21:08:42 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:48.101 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 21:08:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:48.101 software 00:07:48.101 00:07:48.101 real 0m0.229s 00:07:48.101 user 0m0.045s 00:07:48.101 sys 0m0.010s 00:07:48.101 21:08:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:48.101 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.101 ************************************ 00:07:48.101 END TEST accel_assign_opcode 00:07:48.101 ************************************ 00:07:48.361 21:08:42 -- accel/accel_rpc.sh@55 -- # killprocess 1181144 00:07:48.361 21:08:42 -- common/autotest_common.sh@936 -- # '[' -z 1181144 ']' 00:07:48.361 21:08:42 -- common/autotest_common.sh@940 -- # kill -0 1181144 00:07:48.361 21:08:42 -- common/autotest_common.sh@941 -- # uname 00:07:48.361 21:08:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.361 21:08:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1181144 00:07:48.361 21:08:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:48.361 21:08:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:48.361 21:08:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1181144' 00:07:48.361 killing process with pid 1181144 00:07:48.361 21:08:42 -- common/autotest_common.sh@955 -- # kill 1181144 00:07:48.361 21:08:42 -- common/autotest_common.sh@960 -- # wait 1181144 00:07:48.621 00:07:48.621 real 0m1.598s 00:07:48.621 user 0m1.675s 00:07:48.621 sys 0m0.414s 00:07:48.621 21:08:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:48.621 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.621 ************************************ 00:07:48.621 END TEST accel_rpc 00:07:48.621 ************************************ 00:07:48.621 21:08:42 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:48.621 21:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.621 21:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.621 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.880 ************************************ 00:07:48.880 START TEST app_cmdline 00:07:48.880 ************************************ 00:07:48.880 21:08:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:48.880 * Looking for test storage... 00:07:48.880 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:48.880 21:08:42 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:48.880 21:08:42 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1181627 00:07:48.880 21:08:42 -- app/cmdline.sh@18 -- # waitforlisten 1181627 00:07:48.880 21:08:42 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:48.880 21:08:42 -- common/autotest_common.sh@817 -- # '[' -z 1181627 ']' 00:07:48.880 21:08:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.880 21:08:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:48.880 21:08:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.880 21:08:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:48.880 21:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:48.880 [2024-04-23 21:08:43.024187] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:07:48.880 [2024-04-23 21:08:43.024230] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1181627 ] 00:07:48.880 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.880 [2024-04-23 21:08:43.073714] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.880 [2024-04-23 21:08:43.139701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.851 21:08:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:49.851 21:08:43 -- common/autotest_common.sh@850 -- # return 0 00:07:49.851 21:08:43 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:49.851 { 00:07:49.851 "version": "SPDK v24.05-pre git sha1 3f2c8979187", 00:07:49.851 "fields": { 00:07:49.851 "major": 24, 00:07:49.851 "minor": 5, 00:07:49.851 "patch": 0, 00:07:49.851 "suffix": "-pre", 00:07:49.851 "commit": "3f2c8979187" 00:07:49.851 } 00:07:49.851 } 00:07:49.851 21:08:43 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:49.851 21:08:43 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:49.851 21:08:43 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:49.851 21:08:43 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:49.851 21:08:43 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:49.851 21:08:43 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:49.851 21:08:43 -- app/cmdline.sh@26 -- # sort 00:07:49.851 21:08:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:49.851 21:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:49.851 21:08:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:49.851 21:08:43 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:49.851 21:08:43 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:49.851 21:08:43 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:49.851 21:08:43 -- common/autotest_common.sh@638 -- # local es=0 00:07:49.851 21:08:43 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:49.852 21:08:43 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:49.852 21:08:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:49.852 21:08:43 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:49.852 21:08:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:49.852 21:08:43 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:49.852 21:08:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:49.852 21:08:43 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:49.852 21:08:43 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:07:49.852 21:08:43 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.111 request: 00:07:50.111 { 00:07:50.111 "method": "env_dpdk_get_mem_stats", 00:07:50.111 "req_id": 1 00:07:50.111 } 00:07:50.111 Got JSON-RPC error response 00:07:50.111 response: 00:07:50.111 { 00:07:50.111 "code": -32601, 00:07:50.111 "message": "Method not found" 00:07:50.111 } 00:07:50.111 21:08:44 -- common/autotest_common.sh@641 -- # es=1 00:07:50.111 21:08:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:50.111 21:08:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:50.111 21:08:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:50.111 21:08:44 -- app/cmdline.sh@1 -- # killprocess 1181627 00:07:50.111 21:08:44 -- common/autotest_common.sh@936 -- # '[' -z 1181627 ']' 00:07:50.111 21:08:44 -- common/autotest_common.sh@940 -- # kill -0 1181627 00:07:50.111 21:08:44 -- common/autotest_common.sh@941 -- # uname 00:07:50.111 21:08:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:50.111 21:08:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1181627 00:07:50.111 21:08:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:50.111 21:08:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:50.111 21:08:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1181627' 00:07:50.111 killing process with pid 1181627 00:07:50.111 21:08:44 -- common/autotest_common.sh@955 -- # kill 1181627 00:07:50.111 21:08:44 -- common/autotest_common.sh@960 -- # wait 1181627 00:07:50.370 00:07:50.370 real 0m1.608s 00:07:50.370 user 0m1.878s 00:07:50.370 sys 0m0.407s 00:07:50.370 21:08:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:50.370 21:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:50.370 ************************************ 00:07:50.370 END TEST app_cmdline 00:07:50.370 ************************************ 00:07:50.370 21:08:44 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:50.370 21:08:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:50.370 21:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.370 21:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:50.630 ************************************ 00:07:50.630 START TEST version 00:07:50.630 ************************************ 00:07:50.630 21:08:44 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:50.630 * Looking for test storage... 00:07:50.630 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:50.630 21:08:44 -- app/version.sh@17 -- # get_header_version major 00:07:50.630 21:08:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:50.630 21:08:44 -- app/version.sh@14 -- # cut -f2 00:07:50.630 21:08:44 -- app/version.sh@14 -- # tr -d '"' 00:07:50.630 21:08:44 -- app/version.sh@17 -- # major=24 00:07:50.630 21:08:44 -- app/version.sh@18 -- # get_header_version minor 00:07:50.630 21:08:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:50.630 21:08:44 -- app/version.sh@14 -- # cut -f2 00:07:50.630 21:08:44 -- app/version.sh@14 -- # tr -d '"' 00:07:50.630 21:08:44 -- app/version.sh@18 -- # minor=5 00:07:50.630 21:08:44 -- app/version.sh@19 -- # get_header_version patch 00:07:50.630 21:08:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:50.630 21:08:44 -- app/version.sh@14 -- # cut -f2 00:07:50.630 21:08:44 -- app/version.sh@14 -- # tr -d '"' 00:07:50.630 21:08:44 -- app/version.sh@19 -- # patch=0 00:07:50.630 21:08:44 -- app/version.sh@20 -- # get_header_version suffix 00:07:50.630 21:08:44 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:50.630 21:08:44 -- app/version.sh@14 -- # cut -f2 00:07:50.630 21:08:44 -- app/version.sh@14 -- # tr -d '"' 00:07:50.630 21:08:44 -- app/version.sh@20 -- # suffix=-pre 00:07:50.630 21:08:44 -- app/version.sh@22 -- # version=24.5 00:07:50.630 21:08:44 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:50.630 21:08:44 -- app/version.sh@28 -- # version=24.5rc0 00:07:50.630 21:08:44 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:50.630 21:08:44 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:50.630 21:08:44 -- app/version.sh@30 -- # py_version=24.5rc0 00:07:50.630 21:08:44 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:07:50.630 00:07:50.630 real 0m0.158s 00:07:50.630 user 0m0.073s 00:07:50.630 sys 0m0.117s 00:07:50.630 21:08:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:50.630 21:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:50.630 ************************************ 00:07:50.630 END TEST version 00:07:50.630 ************************************ 00:07:50.630 21:08:44 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@194 -- # uname -s 00:07:50.630 21:08:44 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:07:50.630 21:08:44 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:50.630 21:08:44 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:50.630 21:08:44 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@258 -- # timing_exit lib 00:07:50.630 21:08:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:50.630 21:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:50.630 21:08:44 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:07:50.630 21:08:44 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:07:50.630 21:08:44 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:50.630 21:08:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:50.630 21:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.630 21:08:44 -- common/autotest_common.sh@10 -- # set +x 00:07:50.889 ************************************ 00:07:50.889 START TEST nvmf_rdma 00:07:50.889 ************************************ 00:07:50.889 21:08:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:50.889 * Looking for test storage... 00:07:50.889 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:07:50.889 21:08:45 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:50.889 21:08:45 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:50.889 21:08:45 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.889 21:08:45 -- nvmf/common.sh@7 -- # uname -s 00:07:50.889 21:08:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.889 21:08:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.889 21:08:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.889 21:08:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.889 21:08:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.889 21:08:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.889 21:08:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.889 21:08:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.889 21:08:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.889 21:08:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.889 21:08:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:07:50.889 21:08:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:07:50.889 21:08:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.889 21:08:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.889 21:08:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.889 21:08:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:50.889 21:08:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:50.889 21:08:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.889 21:08:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.889 21:08:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.889 21:08:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.889 21:08:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.889 21:08:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.889 21:08:45 -- paths/export.sh@5 -- # export PATH 00:07:50.889 21:08:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.889 21:08:45 -- nvmf/common.sh@47 -- # : 0 00:07:50.889 21:08:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:50.889 21:08:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:50.889 21:08:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:50.889 21:08:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.889 21:08:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.889 21:08:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:50.889 21:08:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:50.889 21:08:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:50.890 21:08:45 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:50.890 21:08:45 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:50.890 21:08:45 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:50.890 21:08:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:50.890 21:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:50.890 21:08:45 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:50.890 21:08:45 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:50.890 21:08:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:50.890 21:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.890 21:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:51.148 ************************************ 00:07:51.148 START TEST nvmf_example 00:07:51.148 ************************************ 00:07:51.148 21:08:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:51.148 * Looking for test storage... 00:07:51.148 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:51.148 21:08:45 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.148 21:08:45 -- nvmf/common.sh@7 -- # uname -s 00:07:51.148 21:08:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.148 21:08:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.148 21:08:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.148 21:08:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.148 21:08:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.148 21:08:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.148 21:08:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.148 21:08:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.148 21:08:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.148 21:08:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.148 21:08:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:07:51.148 21:08:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:07:51.148 21:08:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.148 21:08:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.148 21:08:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.148 21:08:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:51.148 21:08:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:51.148 21:08:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.148 21:08:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.148 21:08:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.148 21:08:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.148 21:08:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.149 21:08:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.149 21:08:45 -- paths/export.sh@5 -- # export PATH 00:07:51.149 21:08:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.149 21:08:45 -- nvmf/common.sh@47 -- # : 0 00:07:51.149 21:08:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:51.149 21:08:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:51.149 21:08:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:51.149 21:08:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.149 21:08:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.149 21:08:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:51.149 21:08:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:51.149 21:08:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:51.149 21:08:45 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:51.149 21:08:45 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:51.149 21:08:45 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:51.149 21:08:45 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:51.149 21:08:45 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:51.149 21:08:45 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:51.149 21:08:45 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:51.149 21:08:45 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:51.149 21:08:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:51.149 21:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:51.149 21:08:45 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:51.149 21:08:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:51.149 21:08:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:51.149 21:08:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:51.149 21:08:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:51.149 21:08:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:51.149 21:08:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:51.149 21:08:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:51.149 21:08:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:51.149 21:08:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:51.149 21:08:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:51.149 21:08:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:51.149 21:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:56.424 21:08:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:56.424 21:08:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:56.424 21:08:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:56.424 21:08:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:56.424 21:08:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:56.424 21:08:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:56.424 21:08:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:56.424 21:08:50 -- nvmf/common.sh@295 -- # net_devs=() 00:07:56.424 21:08:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:56.424 21:08:50 -- nvmf/common.sh@296 -- # e810=() 00:07:56.424 21:08:50 -- nvmf/common.sh@296 -- # local -ga e810 00:07:56.424 21:08:50 -- nvmf/common.sh@297 -- # x722=() 00:07:56.424 21:08:50 -- nvmf/common.sh@297 -- # local -ga x722 00:07:56.424 21:08:50 -- nvmf/common.sh@298 -- # mlx=() 00:07:56.424 21:08:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:56.424 21:08:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:56.424 21:08:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:56.424 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:56.424 21:08:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:56.424 21:08:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:56.424 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:56.424 21:08:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:56.424 21:08:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:56.424 21:08:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:56.424 21:08:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:56.424 Found net devices under 0000:18:00.0: mlx_0_0 00:07:56.424 21:08:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:56.424 21:08:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:56.424 21:08:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:56.424 Found net devices under 0000:18:00.1: mlx_0_1 00:07:56.424 21:08:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:56.424 21:08:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:56.424 21:08:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:56.424 21:08:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:56.424 21:08:50 -- nvmf/common.sh@58 -- # uname 00:07:56.424 21:08:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:56.424 21:08:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:56.424 21:08:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:56.424 21:08:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:56.424 21:08:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:56.424 21:08:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:56.424 21:08:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:56.424 21:08:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:56.424 21:08:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:56.424 21:08:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:56.424 21:08:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:56.424 21:08:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:56.424 21:08:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:56.424 21:08:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:56.424 21:08:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:56.424 21:08:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:56.424 21:08:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:56.424 21:08:50 -- nvmf/common.sh@105 -- # continue 2 00:07:56.424 21:08:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.424 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:56.424 21:08:50 -- nvmf/common.sh@105 -- # continue 2 00:07:56.424 21:08:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:56.424 21:08:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:56.424 21:08:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:56.424 21:08:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:56.424 21:08:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:56.424 21:08:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:56.424 21:08:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:56.424 21:08:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:56.424 21:08:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:56.424 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:56.424 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:07:56.424 altname enp24s0f0np0 00:07:56.424 altname ens785f0np0 00:07:56.424 inet 192.168.100.8/24 scope global mlx_0_0 00:07:56.424 valid_lft forever preferred_lft forever 00:07:56.425 21:08:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:56.425 21:08:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:56.425 21:08:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:56.425 21:08:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:56.425 21:08:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:56.425 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:56.425 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:07:56.425 altname enp24s0f1np1 00:07:56.425 altname ens785f1np1 00:07:56.425 inet 192.168.100.9/24 scope global mlx_0_1 00:07:56.425 valid_lft forever preferred_lft forever 00:07:56.425 21:08:50 -- nvmf/common.sh@411 -- # return 0 00:07:56.425 21:08:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:56.425 21:08:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:56.425 21:08:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:56.425 21:08:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:56.425 21:08:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:56.425 21:08:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:56.425 21:08:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:56.425 21:08:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:56.425 21:08:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:56.425 21:08:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:56.425 21:08:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:56.425 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.425 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:56.425 21:08:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:56.425 21:08:50 -- nvmf/common.sh@105 -- # continue 2 00:07:56.425 21:08:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:56.425 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.425 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:56.425 21:08:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:56.425 21:08:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:56.425 21:08:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@105 -- # continue 2 00:07:56.425 21:08:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:56.425 21:08:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:56.425 21:08:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:56.425 21:08:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:56.425 21:08:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:56.425 21:08:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:56.425 21:08:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:56.425 192.168.100.9' 00:07:56.425 21:08:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:56.425 192.168.100.9' 00:07:56.425 21:08:50 -- nvmf/common.sh@446 -- # head -n 1 00:07:56.425 21:08:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:56.425 21:08:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:56.425 192.168.100.9' 00:07:56.425 21:08:50 -- nvmf/common.sh@447 -- # tail -n +2 00:07:56.425 21:08:50 -- nvmf/common.sh@447 -- # head -n 1 00:07:56.425 21:08:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:56.425 21:08:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:56.425 21:08:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:56.425 21:08:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:56.425 21:08:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:56.425 21:08:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:56.425 21:08:50 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:56.425 21:08:50 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:56.425 21:08:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:56.425 21:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:56.425 21:08:50 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:07:56.425 21:08:50 -- target/nvmf_example.sh@34 -- # nvmfpid=1185288 00:07:56.425 21:08:50 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:56.425 21:08:50 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:56.425 21:08:50 -- target/nvmf_example.sh@36 -- # waitforlisten 1185288 00:07:56.425 21:08:50 -- common/autotest_common.sh@817 -- # '[' -z 1185288 ']' 00:07:56.425 21:08:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:56.425 21:08:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:56.425 21:08:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:56.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:56.425 21:08:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:56.425 21:08:50 -- common/autotest_common.sh@10 -- # set +x 00:07:56.684 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.280 21:08:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:57.280 21:08:51 -- common/autotest_common.sh@850 -- # return 0 00:07:57.280 21:08:51 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:57.280 21:08:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:57.280 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.280 21:08:51 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:57.280 21:08:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:57.280 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.539 21:08:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:57.539 21:08:51 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:57.539 21:08:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:57.539 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.539 21:08:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:57.539 21:08:51 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:57.539 21:08:51 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:57.539 21:08:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:57.539 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.539 21:08:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:57.539 21:08:51 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:57.539 21:08:51 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:57.539 21:08:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:57.539 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.539 21:08:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:57.539 21:08:51 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:57.539 21:08:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:57.539 21:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:57.539 21:08:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:57.539 21:08:51 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:57.539 21:08:51 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:57.539 EAL: No free 2048 kB hugepages reported on node 1 00:08:09.740 Initializing NVMe Controllers 00:08:09.740 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:08:09.740 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:09.740 Initialization complete. Launching workers. 00:08:09.740 ======================================================== 00:08:09.740 Latency(us) 00:08:09.740 Device Information : IOPS MiB/s Average min max 00:08:09.740 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 27493.70 107.40 2328.15 572.42 12055.96 00:08:09.740 ======================================================== 00:08:09.740 Total : 27493.70 107.40 2328.15 572.42 12055.96 00:08:09.740 00:08:09.740 21:09:02 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:09.740 21:09:02 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:09.740 21:09:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:09.740 21:09:02 -- nvmf/common.sh@117 -- # sync 00:08:09.740 21:09:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:09.740 21:09:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:09.740 21:09:02 -- nvmf/common.sh@120 -- # set +e 00:08:09.740 21:09:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:09.740 21:09:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:09.740 rmmod nvme_rdma 00:08:09.740 rmmod nvme_fabrics 00:08:09.741 21:09:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:09.741 21:09:03 -- nvmf/common.sh@124 -- # set -e 00:08:09.741 21:09:03 -- nvmf/common.sh@125 -- # return 0 00:08:09.741 21:09:03 -- nvmf/common.sh@478 -- # '[' -n 1185288 ']' 00:08:09.741 21:09:03 -- nvmf/common.sh@479 -- # killprocess 1185288 00:08:09.741 21:09:03 -- common/autotest_common.sh@936 -- # '[' -z 1185288 ']' 00:08:09.741 21:09:03 -- common/autotest_common.sh@940 -- # kill -0 1185288 00:08:09.741 21:09:03 -- common/autotest_common.sh@941 -- # uname 00:08:09.741 21:09:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:09.741 21:09:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1185288 00:08:09.741 21:09:03 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:09.741 21:09:03 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:09.741 21:09:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1185288' 00:08:09.741 killing process with pid 1185288 00:08:09.741 21:09:03 -- common/autotest_common.sh@955 -- # kill 1185288 00:08:09.741 21:09:03 -- common/autotest_common.sh@960 -- # wait 1185288 00:08:09.741 [2024-04-23 21:09:03.138806] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:09.741 nvmf threads initialize successfully 00:08:09.741 bdev subsystem init successfully 00:08:09.741 created a nvmf target service 00:08:09.741 create targets's poll groups done 00:08:09.741 all subsystems of target started 00:08:09.741 nvmf target is running 00:08:09.741 all subsystems of target stopped 00:08:09.741 destroy targets's poll groups done 00:08:09.741 destroyed the nvmf target service 00:08:09.741 bdev subsystem finish successfully 00:08:09.741 nvmf threads destroy successfully 00:08:09.741 21:09:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:09.741 21:09:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:09.741 21:09:03 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:09.741 21:09:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:09.741 21:09:03 -- common/autotest_common.sh@10 -- # set +x 00:08:09.741 00:08:09.741 real 0m18.087s 00:08:09.741 user 0m51.553s 00:08:09.741 sys 0m4.365s 00:08:09.741 21:09:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:09.741 21:09:03 -- common/autotest_common.sh@10 -- # set +x 00:08:09.741 ************************************ 00:08:09.741 END TEST nvmf_example 00:08:09.741 ************************************ 00:08:09.741 21:09:03 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:09.741 21:09:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:09.741 21:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:09.741 21:09:03 -- common/autotest_common.sh@10 -- # set +x 00:08:09.741 ************************************ 00:08:09.741 START TEST nvmf_filesystem 00:08:09.741 ************************************ 00:08:09.741 21:09:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:09.741 * Looking for test storage... 00:08:09.741 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.741 21:09:03 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:08:09.741 21:09:03 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:09.741 21:09:03 -- common/autotest_common.sh@34 -- # set -e 00:08:09.741 21:09:03 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:09.741 21:09:03 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:09.741 21:09:03 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:08:09.741 21:09:03 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:09.741 21:09:03 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:08:09.741 21:09:03 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:09.741 21:09:03 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:09.741 21:09:03 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:09.741 21:09:03 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:09.741 21:09:03 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:09.741 21:09:03 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:09.741 21:09:03 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:09.741 21:09:03 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:09.741 21:09:03 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:09.741 21:09:03 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:09.741 21:09:03 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:09.741 21:09:03 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:09.741 21:09:03 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:09.741 21:09:03 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:09.741 21:09:03 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:09.741 21:09:03 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:09.741 21:09:03 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:08:09.741 21:09:03 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:09.741 21:09:03 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:09.741 21:09:03 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:09.741 21:09:03 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:09.741 21:09:03 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:09.741 21:09:03 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:09.741 21:09:03 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:09.741 21:09:03 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:09.741 21:09:03 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:09.741 21:09:03 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:09.741 21:09:03 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:09.741 21:09:03 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:09.741 21:09:03 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:09.741 21:09:03 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:09.741 21:09:03 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:09.741 21:09:03 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:08:09.741 21:09:03 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:09.741 21:09:03 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:09.741 21:09:03 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:09.741 21:09:03 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:09.741 21:09:03 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:09.741 21:09:03 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:09.741 21:09:03 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:09.741 21:09:03 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:09.741 21:09:03 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:09.741 21:09:03 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:09.741 21:09:03 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:09.741 21:09:03 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:09.741 21:09:03 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:08:09.741 21:09:03 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:09.741 21:09:03 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:08:09.741 21:09:03 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:08:09.741 21:09:03 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:08:09.741 21:09:03 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:08:09.741 21:09:03 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:08:09.741 21:09:03 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:08:09.741 21:09:03 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:08:09.741 21:09:03 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:08:09.741 21:09:03 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:08:09.741 21:09:03 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:08:09.741 21:09:03 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:08:09.741 21:09:03 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:08:09.741 21:09:03 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:08:09.741 21:09:03 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:09.741 21:09:03 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:08:09.741 21:09:03 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:08:09.741 21:09:03 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:08:09.741 21:09:03 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:08:09.741 21:09:03 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:08:09.741 21:09:03 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:08:09.741 21:09:03 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:08:09.741 21:09:03 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:08:09.741 21:09:03 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:08:09.741 21:09:03 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:08:09.741 21:09:03 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:08:09.741 21:09:03 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:09.741 21:09:03 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:08:09.741 21:09:03 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:08:09.741 21:09:03 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:08:09.741 21:09:03 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:08:09.741 21:09:03 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:08:09.741 21:09:03 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:08:09.741 21:09:03 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:08:09.741 21:09:03 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:09.741 21:09:03 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:09.741 21:09:03 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:09.741 21:09:03 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:09.741 21:09:03 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:09.742 21:09:03 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:09.742 21:09:03 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:09.742 21:09:03 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:09.742 21:09:03 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:09.742 21:09:03 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:08:09.742 21:09:03 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:09.742 #define SPDK_CONFIG_H 00:08:09.742 #define SPDK_CONFIG_APPS 1 00:08:09.742 #define SPDK_CONFIG_ARCH native 00:08:09.742 #undef SPDK_CONFIG_ASAN 00:08:09.742 #undef SPDK_CONFIG_AVAHI 00:08:09.742 #undef SPDK_CONFIG_CET 00:08:09.742 #define SPDK_CONFIG_COVERAGE 1 00:08:09.742 #define SPDK_CONFIG_CROSS_PREFIX 00:08:09.742 #undef SPDK_CONFIG_CRYPTO 00:08:09.742 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:09.742 #undef SPDK_CONFIG_CUSTOMOCF 00:08:09.742 #undef SPDK_CONFIG_DAOS 00:08:09.742 #define SPDK_CONFIG_DAOS_DIR 00:08:09.742 #define SPDK_CONFIG_DEBUG 1 00:08:09.742 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:09.742 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:08:09.742 #define SPDK_CONFIG_DPDK_INC_DIR 00:08:09.742 #define SPDK_CONFIG_DPDK_LIB_DIR 00:08:09.742 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:09.742 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:08:09.742 #define SPDK_CONFIG_EXAMPLES 1 00:08:09.742 #undef SPDK_CONFIG_FC 00:08:09.742 #define SPDK_CONFIG_FC_PATH 00:08:09.742 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:09.742 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:09.742 #undef SPDK_CONFIG_FUSE 00:08:09.742 #undef SPDK_CONFIG_FUZZER 00:08:09.742 #define SPDK_CONFIG_FUZZER_LIB 00:08:09.742 #undef SPDK_CONFIG_GOLANG 00:08:09.742 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:09.742 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:08:09.742 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:09.742 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:08:09.742 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:09.742 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:09.742 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:09.742 #define SPDK_CONFIG_IDXD 1 00:08:09.742 #undef SPDK_CONFIG_IDXD_KERNEL 00:08:09.742 #undef SPDK_CONFIG_IPSEC_MB 00:08:09.742 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:09.742 #define SPDK_CONFIG_ISAL 1 00:08:09.742 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:09.742 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:09.742 #define SPDK_CONFIG_LIBDIR 00:08:09.742 #undef SPDK_CONFIG_LTO 00:08:09.742 #define SPDK_CONFIG_MAX_LCORES 00:08:09.742 #define SPDK_CONFIG_NVME_CUSE 1 00:08:09.742 #undef SPDK_CONFIG_OCF 00:08:09.742 #define SPDK_CONFIG_OCF_PATH 00:08:09.742 #define SPDK_CONFIG_OPENSSL_PATH 00:08:09.742 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:09.742 #define SPDK_CONFIG_PGO_DIR 00:08:09.742 #undef SPDK_CONFIG_PGO_USE 00:08:09.742 #define SPDK_CONFIG_PREFIX /usr/local 00:08:09.742 #undef SPDK_CONFIG_RAID5F 00:08:09.742 #undef SPDK_CONFIG_RBD 00:08:09.742 #define SPDK_CONFIG_RDMA 1 00:08:09.742 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:09.742 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:09.742 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:09.742 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:09.742 #define SPDK_CONFIG_SHARED 1 00:08:09.742 #undef SPDK_CONFIG_SMA 00:08:09.742 #define SPDK_CONFIG_TESTS 1 00:08:09.742 #undef SPDK_CONFIG_TSAN 00:08:09.742 #define SPDK_CONFIG_UBLK 1 00:08:09.742 #define SPDK_CONFIG_UBSAN 1 00:08:09.742 #undef SPDK_CONFIG_UNIT_TESTS 00:08:09.742 #undef SPDK_CONFIG_URING 00:08:09.742 #define SPDK_CONFIG_URING_PATH 00:08:09.742 #undef SPDK_CONFIG_URING_ZNS 00:08:09.742 #undef SPDK_CONFIG_USDT 00:08:09.742 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:09.742 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:09.742 #undef SPDK_CONFIG_VFIO_USER 00:08:09.742 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:09.742 #define SPDK_CONFIG_VHOST 1 00:08:09.742 #define SPDK_CONFIG_VIRTIO 1 00:08:09.742 #undef SPDK_CONFIG_VTUNE 00:08:09.742 #define SPDK_CONFIG_VTUNE_DIR 00:08:09.742 #define SPDK_CONFIG_WERROR 1 00:08:09.742 #define SPDK_CONFIG_WPDK_DIR 00:08:09.742 #undef SPDK_CONFIG_XNVME 00:08:09.742 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:09.742 21:09:03 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:09.742 21:09:03 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:09.742 21:09:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:09.742 21:09:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:09.742 21:09:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:09.742 21:09:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.742 21:09:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.742 21:09:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.742 21:09:03 -- paths/export.sh@5 -- # export PATH 00:08:09.742 21:09:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.742 21:09:03 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:08:09.742 21:09:03 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:08:09.742 21:09:03 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:08:09.742 21:09:03 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:08:09.742 21:09:03 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:09.742 21:09:03 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:08:09.742 21:09:03 -- pm/common@67 -- # TEST_TAG=N/A 00:08:09.742 21:09:03 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:08:09.742 21:09:03 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:08:09.742 21:09:03 -- pm/common@71 -- # uname -s 00:08:09.742 21:09:03 -- pm/common@71 -- # PM_OS=Linux 00:08:09.742 21:09:03 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:08:09.742 21:09:03 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:08:09.742 21:09:03 -- pm/common@76 -- # [[ Linux == Linux ]] 00:08:09.742 21:09:03 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:08:09.742 21:09:03 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:08:09.742 21:09:03 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:08:09.742 21:09:03 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:08:09.742 21:09:03 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:08:09.742 21:09:03 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:08:09.742 21:09:03 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:08:09.742 21:09:03 -- common/autotest_common.sh@57 -- # : 1 00:08:09.742 21:09:03 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:08:09.742 21:09:03 -- common/autotest_common.sh@61 -- # : 0 00:08:09.742 21:09:03 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:09.742 21:09:03 -- common/autotest_common.sh@63 -- # : 0 00:08:09.742 21:09:03 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:08:09.742 21:09:03 -- common/autotest_common.sh@65 -- # : 1 00:08:09.742 21:09:03 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:09.742 21:09:03 -- common/autotest_common.sh@67 -- # : 0 00:08:09.742 21:09:03 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:08:09.742 21:09:03 -- common/autotest_common.sh@69 -- # : 00:08:09.742 21:09:03 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:08:09.742 21:09:03 -- common/autotest_common.sh@71 -- # : 0 00:08:09.742 21:09:03 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:08:09.742 21:09:03 -- common/autotest_common.sh@73 -- # : 0 00:08:09.742 21:09:03 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:08:09.743 21:09:03 -- common/autotest_common.sh@75 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:08:09.743 21:09:03 -- common/autotest_common.sh@77 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:09.743 21:09:03 -- common/autotest_common.sh@79 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:08:09.743 21:09:03 -- common/autotest_common.sh@81 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:08:09.743 21:09:03 -- common/autotest_common.sh@83 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:08:09.743 21:09:03 -- common/autotest_common.sh@85 -- # : 1 00:08:09.743 21:09:03 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:08:09.743 21:09:03 -- common/autotest_common.sh@87 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:08:09.743 21:09:03 -- common/autotest_common.sh@89 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:08:09.743 21:09:03 -- common/autotest_common.sh@91 -- # : 1 00:08:09.743 21:09:03 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:08:09.743 21:09:03 -- common/autotest_common.sh@93 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:08:09.743 21:09:03 -- common/autotest_common.sh@95 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:09.743 21:09:03 -- common/autotest_common.sh@97 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:08:09.743 21:09:03 -- common/autotest_common.sh@99 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:08:09.743 21:09:03 -- common/autotest_common.sh@101 -- # : rdma 00:08:09.743 21:09:03 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:09.743 21:09:03 -- common/autotest_common.sh@103 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:08:09.743 21:09:03 -- common/autotest_common.sh@105 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:08:09.743 21:09:03 -- common/autotest_common.sh@107 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:08:09.743 21:09:03 -- common/autotest_common.sh@109 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:08:09.743 21:09:03 -- common/autotest_common.sh@111 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:08:09.743 21:09:03 -- common/autotest_common.sh@113 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:08:09.743 21:09:03 -- common/autotest_common.sh@115 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:08:09.743 21:09:03 -- common/autotest_common.sh@117 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:09.743 21:09:03 -- common/autotest_common.sh@119 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:08:09.743 21:09:03 -- common/autotest_common.sh@121 -- # : 1 00:08:09.743 21:09:03 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:08:09.743 21:09:03 -- common/autotest_common.sh@123 -- # : 00:08:09.743 21:09:03 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:09.743 21:09:03 -- common/autotest_common.sh@125 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:08:09.743 21:09:03 -- common/autotest_common.sh@127 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:08:09.743 21:09:03 -- common/autotest_common.sh@129 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:08:09.743 21:09:03 -- common/autotest_common.sh@131 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:08:09.743 21:09:03 -- common/autotest_common.sh@133 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:08:09.743 21:09:03 -- common/autotest_common.sh@135 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:08:09.743 21:09:03 -- common/autotest_common.sh@137 -- # : 00:08:09.743 21:09:03 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:08:09.743 21:09:03 -- common/autotest_common.sh@139 -- # : true 00:08:09.743 21:09:03 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:08:09.743 21:09:03 -- common/autotest_common.sh@141 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:08:09.743 21:09:03 -- common/autotest_common.sh@143 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:08:09.743 21:09:03 -- common/autotest_common.sh@145 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:08:09.743 21:09:03 -- common/autotest_common.sh@147 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:08:09.743 21:09:03 -- common/autotest_common.sh@149 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:08:09.743 21:09:03 -- common/autotest_common.sh@151 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:08:09.743 21:09:03 -- common/autotest_common.sh@153 -- # : mlx5 00:08:09.743 21:09:03 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:08:09.743 21:09:03 -- common/autotest_common.sh@155 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:08:09.743 21:09:03 -- common/autotest_common.sh@157 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:08:09.743 21:09:03 -- common/autotest_common.sh@159 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:08:09.743 21:09:03 -- common/autotest_common.sh@161 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:08:09.743 21:09:03 -- common/autotest_common.sh@163 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:08:09.743 21:09:03 -- common/autotest_common.sh@166 -- # : 00:08:09.743 21:09:03 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:08:09.743 21:09:03 -- common/autotest_common.sh@168 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:08:09.743 21:09:03 -- common/autotest_common.sh@170 -- # : 0 00:08:09.743 21:09:03 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:09.743 21:09:03 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:09.743 21:09:03 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:09.743 21:09:03 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:09.743 21:09:03 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:09.743 21:09:03 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:09.743 21:09:03 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:09.743 21:09:03 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:08:09.743 21:09:03 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:09.743 21:09:03 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:09.743 21:09:03 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:09.744 21:09:03 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:09.744 21:09:03 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:09.744 21:09:03 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:08:09.744 21:09:03 -- common/autotest_common.sh@199 -- # cat 00:08:09.744 21:09:03 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:08:09.744 21:09:03 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:09.744 21:09:03 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:09.744 21:09:03 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:09.744 21:09:03 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:09.744 21:09:03 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:08:09.744 21:09:03 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:08:09.744 21:09:03 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:09.744 21:09:03 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:09.744 21:09:03 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:09.744 21:09:03 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:09.744 21:09:03 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:09.744 21:09:03 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:09.744 21:09:03 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:09.744 21:09:03 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:09.744 21:09:03 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:09.744 21:09:03 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:09.744 21:09:03 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:09.744 21:09:03 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:09.744 21:09:03 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:08:09.744 21:09:03 -- common/autotest_common.sh@252 -- # export valgrind= 00:08:09.744 21:09:03 -- common/autotest_common.sh@252 -- # valgrind= 00:08:09.744 21:09:03 -- common/autotest_common.sh@258 -- # uname -s 00:08:09.744 21:09:03 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:08:09.744 21:09:03 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:08:09.744 21:09:03 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:08:09.744 21:09:03 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:08:09.744 21:09:03 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@268 -- # MAKE=make 00:08:09.744 21:09:03 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j112 00:08:09.744 21:09:03 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:08:09.744 21:09:03 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:08:09.744 21:09:03 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:08:09.744 21:09:03 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:08:09.744 21:09:03 -- common/autotest_common.sh@289 -- # for i in "$@" 00:08:09.744 21:09:03 -- common/autotest_common.sh@290 -- # case "$i" in 00:08:09.744 21:09:03 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:08:09.744 21:09:03 -- common/autotest_common.sh@307 -- # [[ -z 1187862 ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@307 -- # kill -0 1187862 00:08:09.744 21:09:03 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:08:09.744 21:09:03 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:08:09.744 21:09:03 -- common/autotest_common.sh@320 -- # local mount target_dir 00:08:09.744 21:09:03 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:08:09.744 21:09:03 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:08:09.744 21:09:03 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:08:09.744 21:09:03 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:08:09.744 21:09:03 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.v06aoj 00:08:09.744 21:09:03 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:09.744 21:09:03 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.v06aoj/tests/target /tmp/spdk.v06aoj 00:08:09.744 21:09:03 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@316 -- # df -T 00:08:09.744 21:09:03 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=958902272 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=4325527552 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=89324429312 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95554760704 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=6230331392 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=47776100352 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777378304 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=19101519872 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19110952960 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=9433088 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=47776993280 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777382400 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=389120 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # avails["$mount"]=9555468288 00:08:09.744 21:09:03 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9555472384 00:08:09.744 21:09:03 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:08:09.744 21:09:03 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:09.744 21:09:03 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:08:09.744 * Looking for test storage... 00:08:09.744 21:09:03 -- common/autotest_common.sh@357 -- # local target_space new_size 00:08:09.744 21:09:03 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:08:09.744 21:09:03 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.744 21:09:03 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:09.744 21:09:03 -- common/autotest_common.sh@361 -- # mount=/ 00:08:09.744 21:09:03 -- common/autotest_common.sh@363 -- # target_space=89324429312 00:08:09.744 21:09:03 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:08:09.744 21:09:03 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:08:09.744 21:09:03 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@370 -- # new_size=8444923904 00:08:09.744 21:09:03 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:09.744 21:09:03 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.744 21:09:03 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.744 21:09:03 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.744 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.744 21:09:03 -- common/autotest_common.sh@378 -- # return 0 00:08:09.744 21:09:03 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:08:09.744 21:09:03 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:08:09.744 21:09:03 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:09.744 21:09:03 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:09.744 21:09:03 -- common/autotest_common.sh@1673 -- # true 00:08:09.744 21:09:03 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:08:09.744 21:09:03 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:09.744 21:09:03 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:09.745 21:09:03 -- common/autotest_common.sh@27 -- # exec 00:08:09.745 21:09:03 -- common/autotest_common.sh@29 -- # exec 00:08:09.745 21:09:03 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:09.745 21:09:03 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:09.745 21:09:03 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:09.745 21:09:03 -- common/autotest_common.sh@18 -- # set -x 00:08:09.745 21:09:03 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:09.745 21:09:03 -- nvmf/common.sh@7 -- # uname -s 00:08:09.745 21:09:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:09.745 21:09:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:09.745 21:09:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:09.745 21:09:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:09.745 21:09:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:09.745 21:09:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:09.745 21:09:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:09.745 21:09:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:09.745 21:09:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:09.745 21:09:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:09.745 21:09:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:09.745 21:09:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:09.745 21:09:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:09.745 21:09:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:09.745 21:09:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:09.745 21:09:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:09.745 21:09:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:09.745 21:09:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:09.745 21:09:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:09.745 21:09:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:09.745 21:09:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.745 21:09:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.745 21:09:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.745 21:09:03 -- paths/export.sh@5 -- # export PATH 00:08:09.745 21:09:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.745 21:09:03 -- nvmf/common.sh@47 -- # : 0 00:08:09.745 21:09:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:09.745 21:09:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:09.745 21:09:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:09.745 21:09:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:09.745 21:09:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:09.745 21:09:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:09.745 21:09:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:09.745 21:09:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:09.745 21:09:03 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:09.745 21:09:03 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:09.745 21:09:03 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:09.745 21:09:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:09.745 21:09:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:09.745 21:09:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:09.745 21:09:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:09.745 21:09:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:09.745 21:09:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:09.745 21:09:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:09.745 21:09:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:09.745 21:09:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:09.745 21:09:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:09.745 21:09:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:09.745 21:09:03 -- common/autotest_common.sh@10 -- # set +x 00:08:15.062 21:09:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:15.062 21:09:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:15.062 21:09:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:15.062 21:09:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:15.062 21:09:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:15.062 21:09:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:15.062 21:09:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:15.062 21:09:09 -- nvmf/common.sh@295 -- # net_devs=() 00:08:15.062 21:09:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:15.062 21:09:09 -- nvmf/common.sh@296 -- # e810=() 00:08:15.062 21:09:09 -- nvmf/common.sh@296 -- # local -ga e810 00:08:15.062 21:09:09 -- nvmf/common.sh@297 -- # x722=() 00:08:15.062 21:09:09 -- nvmf/common.sh@297 -- # local -ga x722 00:08:15.062 21:09:09 -- nvmf/common.sh@298 -- # mlx=() 00:08:15.062 21:09:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:15.062 21:09:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:15.062 21:09:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:15.062 21:09:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:15.062 21:09:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:15.062 21:09:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:15.062 21:09:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:15.062 21:09:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:15.062 21:09:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:15.062 21:09:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:15.062 21:09:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:15.062 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:15.062 21:09:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:15.062 21:09:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:15.062 21:09:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:15.062 21:09:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:15.063 21:09:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:15.063 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:15.063 21:09:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:15.063 21:09:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:15.063 21:09:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:15.063 21:09:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:15.063 21:09:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:15.063 21:09:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:15.063 Found net devices under 0000:18:00.0: mlx_0_0 00:08:15.063 21:09:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:15.063 21:09:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:15.063 21:09:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:15.063 21:09:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:15.063 21:09:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:15.063 Found net devices under 0000:18:00.1: mlx_0_1 00:08:15.063 21:09:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:15.063 21:09:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:15.063 21:09:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:15.063 21:09:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:15.063 21:09:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:15.063 21:09:09 -- nvmf/common.sh@58 -- # uname 00:08:15.063 21:09:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:15.063 21:09:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:15.063 21:09:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:15.063 21:09:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:15.063 21:09:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:15.063 21:09:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:15.063 21:09:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:15.063 21:09:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:15.063 21:09:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:15.063 21:09:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:15.063 21:09:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:15.063 21:09:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:15.063 21:09:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:15.063 21:09:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:15.063 21:09:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:15.063 21:09:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:15.063 21:09:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:15.063 21:09:09 -- nvmf/common.sh@105 -- # continue 2 00:08:15.063 21:09:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.063 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:15.063 21:09:09 -- nvmf/common.sh@105 -- # continue 2 00:08:15.063 21:09:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:15.063 21:09:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:15.063 21:09:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:15.063 21:09:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:15.063 21:09:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:15.063 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:15.063 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:15.063 altname enp24s0f0np0 00:08:15.063 altname ens785f0np0 00:08:15.063 inet 192.168.100.8/24 scope global mlx_0_0 00:08:15.063 valid_lft forever preferred_lft forever 00:08:15.063 21:09:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:15.063 21:09:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:15.063 21:09:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:15.063 21:09:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:15.063 21:09:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:15.063 21:09:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:15.063 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:15.063 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:15.063 altname enp24s0f1np1 00:08:15.063 altname ens785f1np1 00:08:15.063 inet 192.168.100.9/24 scope global mlx_0_1 00:08:15.063 valid_lft forever preferred_lft forever 00:08:15.063 21:09:09 -- nvmf/common.sh@411 -- # return 0 00:08:15.063 21:09:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:15.063 21:09:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:15.063 21:09:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:15.063 21:09:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:15.063 21:09:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:15.063 21:09:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:15.063 21:09:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:15.064 21:09:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:15.064 21:09:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:15.064 21:09:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:15.064 21:09:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:15.064 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.064 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:15.064 21:09:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:15.064 21:09:09 -- nvmf/common.sh@105 -- # continue 2 00:08:15.064 21:09:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:15.064 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.064 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:15.064 21:09:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:15.064 21:09:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:15.064 21:09:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:15.064 21:09:09 -- nvmf/common.sh@105 -- # continue 2 00:08:15.064 21:09:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:15.064 21:09:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:15.064 21:09:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:15.064 21:09:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:15.064 21:09:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:15.064 21:09:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:15.064 21:09:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:15.064 21:09:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:15.064 192.168.100.9' 00:08:15.064 21:09:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:15.064 192.168.100.9' 00:08:15.064 21:09:09 -- nvmf/common.sh@446 -- # head -n 1 00:08:15.064 21:09:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:15.064 21:09:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:15.064 192.168.100.9' 00:08:15.064 21:09:09 -- nvmf/common.sh@447 -- # tail -n +2 00:08:15.064 21:09:09 -- nvmf/common.sh@447 -- # head -n 1 00:08:15.064 21:09:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:15.064 21:09:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:15.064 21:09:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:15.064 21:09:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:15.064 21:09:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:15.064 21:09:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:15.064 21:09:09 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:15.064 21:09:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:15.064 21:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:15.064 21:09:09 -- common/autotest_common.sh@10 -- # set +x 00:08:15.323 ************************************ 00:08:15.323 START TEST nvmf_filesystem_no_in_capsule 00:08:15.323 ************************************ 00:08:15.323 21:09:09 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:08:15.323 21:09:09 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:15.323 21:09:09 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:15.323 21:09:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:15.323 21:09:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:15.323 21:09:09 -- common/autotest_common.sh@10 -- # set +x 00:08:15.324 21:09:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:15.324 21:09:09 -- nvmf/common.sh@470 -- # nvmfpid=1191605 00:08:15.324 21:09:09 -- nvmf/common.sh@471 -- # waitforlisten 1191605 00:08:15.324 21:09:09 -- common/autotest_common.sh@817 -- # '[' -z 1191605 ']' 00:08:15.324 21:09:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:15.324 21:09:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:15.324 21:09:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:15.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:15.324 21:09:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:15.324 21:09:09 -- common/autotest_common.sh@10 -- # set +x 00:08:15.324 [2024-04-23 21:09:09.443320] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:08:15.324 [2024-04-23 21:09:09.443353] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:15.324 EAL: No free 2048 kB hugepages reported on node 1 00:08:15.324 [2024-04-23 21:09:09.493289] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:15.324 [2024-04-23 21:09:09.566284] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:15.324 [2024-04-23 21:09:09.566322] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:15.324 [2024-04-23 21:09:09.566329] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:15.324 [2024-04-23 21:09:09.566334] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:15.324 [2024-04-23 21:09:09.566338] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:15.324 [2024-04-23 21:09:09.566377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:15.324 [2024-04-23 21:09:09.566472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:15.324 [2024-04-23 21:09:09.566562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:15.324 [2024-04-23 21:09:09.566563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.259 21:09:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:16.259 21:09:10 -- common/autotest_common.sh@850 -- # return 0 00:08:16.259 21:09:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:16.259 21:09:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 21:09:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:16.259 21:09:10 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:16.259 21:09:10 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:16.259 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 [2024-04-23 21:09:10.271943] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:16.259 [2024-04-23 21:09:10.291652] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x160b6b0/0x160fba0) succeed. 00:08:16.259 [2024-04-23 21:09:10.301027] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x160ccf0/0x1651230) succeed. 00:08:16.259 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.259 21:09:10 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:16.259 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 Malloc1 00:08:16.259 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.259 21:09:10 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:16.259 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.259 21:09:10 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:16.259 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.259 21:09:10 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:16.259 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.259 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.259 [2024-04-23 21:09:10.529324] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:16.518 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.518 21:09:10 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:16.518 21:09:10 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:16.518 21:09:10 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:16.518 21:09:10 -- common/autotest_common.sh@1366 -- # local bs 00:08:16.518 21:09:10 -- common/autotest_common.sh@1367 -- # local nb 00:08:16.518 21:09:10 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:16.518 21:09:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.518 21:09:10 -- common/autotest_common.sh@10 -- # set +x 00:08:16.518 21:09:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.518 21:09:10 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:16.518 { 00:08:16.518 "name": "Malloc1", 00:08:16.518 "aliases": [ 00:08:16.518 "0df16e09-3bed-4e20-8808-1c71a94fb05b" 00:08:16.518 ], 00:08:16.518 "product_name": "Malloc disk", 00:08:16.518 "block_size": 512, 00:08:16.518 "num_blocks": 1048576, 00:08:16.518 "uuid": "0df16e09-3bed-4e20-8808-1c71a94fb05b", 00:08:16.518 "assigned_rate_limits": { 00:08:16.518 "rw_ios_per_sec": 0, 00:08:16.518 "rw_mbytes_per_sec": 0, 00:08:16.518 "r_mbytes_per_sec": 0, 00:08:16.518 "w_mbytes_per_sec": 0 00:08:16.518 }, 00:08:16.518 "claimed": true, 00:08:16.518 "claim_type": "exclusive_write", 00:08:16.518 "zoned": false, 00:08:16.518 "supported_io_types": { 00:08:16.518 "read": true, 00:08:16.518 "write": true, 00:08:16.518 "unmap": true, 00:08:16.518 "write_zeroes": true, 00:08:16.518 "flush": true, 00:08:16.518 "reset": true, 00:08:16.518 "compare": false, 00:08:16.518 "compare_and_write": false, 00:08:16.518 "abort": true, 00:08:16.518 "nvme_admin": false, 00:08:16.518 "nvme_io": false 00:08:16.518 }, 00:08:16.518 "memory_domains": [ 00:08:16.518 { 00:08:16.518 "dma_device_id": "system", 00:08:16.518 "dma_device_type": 1 00:08:16.518 }, 00:08:16.518 { 00:08:16.518 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:16.518 "dma_device_type": 2 00:08:16.518 } 00:08:16.518 ], 00:08:16.518 "driver_specific": {} 00:08:16.518 } 00:08:16.518 ]' 00:08:16.518 21:09:10 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:16.518 21:09:10 -- common/autotest_common.sh@1369 -- # bs=512 00:08:16.518 21:09:10 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:16.518 21:09:10 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:16.518 21:09:10 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:16.518 21:09:10 -- common/autotest_common.sh@1374 -- # echo 512 00:08:16.518 21:09:10 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:16.519 21:09:10 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:17.455 21:09:11 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:17.455 21:09:11 -- common/autotest_common.sh@1184 -- # local i=0 00:08:17.455 21:09:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:17.455 21:09:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:17.455 21:09:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:19.387 21:09:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:19.387 21:09:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:19.387 21:09:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:19.387 21:09:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:19.387 21:09:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:19.387 21:09:13 -- common/autotest_common.sh@1194 -- # return 0 00:08:19.387 21:09:13 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:19.387 21:09:13 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:19.646 21:09:13 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:19.646 21:09:13 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:19.646 21:09:13 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:19.646 21:09:13 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:19.647 21:09:13 -- setup/common.sh@80 -- # echo 536870912 00:08:19.647 21:09:13 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:19.647 21:09:13 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:19.647 21:09:13 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:19.647 21:09:13 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:19.647 21:09:13 -- target/filesystem.sh@69 -- # partprobe 00:08:19.647 21:09:13 -- target/filesystem.sh@70 -- # sleep 1 00:08:20.583 21:09:14 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:20.583 21:09:14 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:20.583 21:09:14 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:20.583 21:09:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:20.583 21:09:14 -- common/autotest_common.sh@10 -- # set +x 00:08:20.843 ************************************ 00:08:20.843 START TEST filesystem_ext4 00:08:20.843 ************************************ 00:08:20.843 21:09:14 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:20.843 21:09:14 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:20.843 21:09:14 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:20.843 21:09:14 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:20.843 21:09:14 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:20.843 21:09:14 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:20.843 21:09:14 -- common/autotest_common.sh@914 -- # local i=0 00:08:20.843 21:09:14 -- common/autotest_common.sh@915 -- # local force 00:08:20.843 21:09:14 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:20.843 21:09:14 -- common/autotest_common.sh@918 -- # force=-F 00:08:20.843 21:09:14 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:20.843 mke2fs 1.46.5 (30-Dec-2021) 00:08:20.843 Discarding device blocks: 0/522240 done 00:08:20.843 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:20.843 Filesystem UUID: adf065dd-8502-42bd-8508-963efe8de5f5 00:08:20.843 Superblock backups stored on blocks: 00:08:20.843 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:20.843 00:08:20.843 Allocating group tables: 0/64 done 00:08:20.843 Writing inode tables: 0/64 done 00:08:20.843 Creating journal (8192 blocks): done 00:08:20.843 Writing superblocks and filesystem accounting information: 0/64 done 00:08:20.843 00:08:20.843 21:09:15 -- common/autotest_common.sh@931 -- # return 0 00:08:20.843 21:09:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:20.843 21:09:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:20.843 21:09:15 -- target/filesystem.sh@25 -- # sync 00:08:20.843 21:09:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:20.843 21:09:15 -- target/filesystem.sh@27 -- # sync 00:08:20.843 21:09:15 -- target/filesystem.sh@29 -- # i=0 00:08:20.843 21:09:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:20.843 21:09:15 -- target/filesystem.sh@37 -- # kill -0 1191605 00:08:20.843 21:09:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:20.843 21:09:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:20.843 21:09:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:20.843 21:09:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:20.843 00:08:20.843 real 0m0.178s 00:08:20.843 user 0m0.017s 00:08:20.843 sys 0m0.066s 00:08:20.843 21:09:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:20.843 21:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:20.843 ************************************ 00:08:20.843 END TEST filesystem_ext4 00:08:20.843 ************************************ 00:08:21.102 21:09:15 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:21.102 21:09:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:21.102 21:09:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.102 21:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:21.102 ************************************ 00:08:21.102 START TEST filesystem_btrfs 00:08:21.102 ************************************ 00:08:21.102 21:09:15 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:21.102 21:09:15 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:21.102 21:09:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.102 21:09:15 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:21.102 21:09:15 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:21.102 21:09:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:21.102 21:09:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:21.102 21:09:15 -- common/autotest_common.sh@915 -- # local force 00:08:21.102 21:09:15 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:21.102 21:09:15 -- common/autotest_common.sh@920 -- # force=-f 00:08:21.102 21:09:15 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:21.102 btrfs-progs v6.6.2 00:08:21.102 See https://btrfs.readthedocs.io for more information. 00:08:21.102 00:08:21.102 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:21.102 NOTE: several default settings have changed in version 5.15, please make sure 00:08:21.102 this does not affect your deployments: 00:08:21.102 - DUP for metadata (-m dup) 00:08:21.102 - enabled no-holes (-O no-holes) 00:08:21.102 - enabled free-space-tree (-R free-space-tree) 00:08:21.102 00:08:21.102 Label: (null) 00:08:21.102 UUID: a7621f4c-bb48-48b0-9412-24535ba6c0eb 00:08:21.102 Node size: 16384 00:08:21.102 Sector size: 4096 00:08:21.102 Filesystem size: 510.00MiB 00:08:21.102 Block group profiles: 00:08:21.102 Data: single 8.00MiB 00:08:21.102 Metadata: DUP 32.00MiB 00:08:21.102 System: DUP 8.00MiB 00:08:21.102 SSD detected: yes 00:08:21.102 Zoned device: no 00:08:21.102 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:21.102 Runtime features: free-space-tree 00:08:21.102 Checksum: crc32c 00:08:21.102 Number of devices: 1 00:08:21.102 Devices: 00:08:21.102 ID SIZE PATH 00:08:21.102 1 510.00MiB /dev/nvme0n1p1 00:08:21.102 00:08:21.102 21:09:15 -- common/autotest_common.sh@931 -- # return 0 00:08:21.102 21:09:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:21.361 21:09:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:21.362 21:09:15 -- target/filesystem.sh@25 -- # sync 00:08:21.362 21:09:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:21.362 21:09:15 -- target/filesystem.sh@27 -- # sync 00:08:21.362 21:09:15 -- target/filesystem.sh@29 -- # i=0 00:08:21.362 21:09:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:21.362 21:09:15 -- target/filesystem.sh@37 -- # kill -0 1191605 00:08:21.362 21:09:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:21.362 21:09:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:21.362 21:09:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:21.362 21:09:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:21.362 00:08:21.362 real 0m0.239s 00:08:21.362 user 0m0.028s 00:08:21.362 sys 0m0.114s 00:08:21.362 21:09:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:21.362 21:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:21.362 ************************************ 00:08:21.362 END TEST filesystem_btrfs 00:08:21.362 ************************************ 00:08:21.362 21:09:15 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:21.362 21:09:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:21.362 21:09:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.362 21:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:21.621 ************************************ 00:08:21.621 START TEST filesystem_xfs 00:08:21.621 ************************************ 00:08:21.621 21:09:15 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:21.621 21:09:15 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:21.621 21:09:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.621 21:09:15 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:21.621 21:09:15 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:21.621 21:09:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:21.621 21:09:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:21.621 21:09:15 -- common/autotest_common.sh@915 -- # local force 00:08:21.621 21:09:15 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:21.621 21:09:15 -- common/autotest_common.sh@920 -- # force=-f 00:08:21.621 21:09:15 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:21.621 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:21.621 = sectsz=512 attr=2, projid32bit=1 00:08:21.621 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:21.621 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:21.621 data = bsize=4096 blocks=130560, imaxpct=25 00:08:21.621 = sunit=0 swidth=0 blks 00:08:21.621 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:21.621 log =internal log bsize=4096 blocks=16384, version=2 00:08:21.621 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:21.621 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:21.621 Discarding blocks...Done. 00:08:21.621 21:09:15 -- common/autotest_common.sh@931 -- # return 0 00:08:21.621 21:09:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:21.621 21:09:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:21.621 21:09:15 -- target/filesystem.sh@25 -- # sync 00:08:21.621 21:09:15 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:21.621 21:09:15 -- target/filesystem.sh@27 -- # sync 00:08:21.621 21:09:15 -- target/filesystem.sh@29 -- # i=0 00:08:21.621 21:09:15 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:21.621 21:09:15 -- target/filesystem.sh@37 -- # kill -0 1191605 00:08:21.621 21:09:15 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:21.621 21:09:15 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:21.621 21:09:15 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:21.621 21:09:15 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:21.621 00:08:21.621 real 0m0.178s 00:08:21.621 user 0m0.027s 00:08:21.621 sys 0m0.061s 00:08:21.621 21:09:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:21.621 21:09:15 -- common/autotest_common.sh@10 -- # set +x 00:08:21.621 ************************************ 00:08:21.621 END TEST filesystem_xfs 00:08:21.621 ************************************ 00:08:21.621 21:09:15 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:21.880 21:09:15 -- target/filesystem.sh@93 -- # sync 00:08:21.880 21:09:15 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:22.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.816 21:09:16 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:22.816 21:09:16 -- common/autotest_common.sh@1205 -- # local i=0 00:08:22.816 21:09:16 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:22.816 21:09:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:22.816 21:09:16 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:22.816 21:09:16 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:22.816 21:09:16 -- common/autotest_common.sh@1217 -- # return 0 00:08:22.816 21:09:16 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:22.816 21:09:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:22.816 21:09:16 -- common/autotest_common.sh@10 -- # set +x 00:08:22.816 21:09:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:22.816 21:09:16 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:22.816 21:09:16 -- target/filesystem.sh@101 -- # killprocess 1191605 00:08:22.816 21:09:16 -- common/autotest_common.sh@936 -- # '[' -z 1191605 ']' 00:08:22.816 21:09:16 -- common/autotest_common.sh@940 -- # kill -0 1191605 00:08:22.816 21:09:16 -- common/autotest_common.sh@941 -- # uname 00:08:22.816 21:09:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:22.816 21:09:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1191605 00:08:22.816 21:09:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:22.816 21:09:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:22.816 21:09:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1191605' 00:08:22.816 killing process with pid 1191605 00:08:22.816 21:09:16 -- common/autotest_common.sh@955 -- # kill 1191605 00:08:22.816 21:09:16 -- common/autotest_common.sh@960 -- # wait 1191605 00:08:22.816 [2024-04-23 21:09:16.977369] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:23.075 21:09:17 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:23.075 00:08:23.075 real 0m7.912s 00:08:23.075 user 0m31.056s 00:08:23.075 sys 0m1.143s 00:08:23.075 21:09:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:23.075 21:09:17 -- common/autotest_common.sh@10 -- # set +x 00:08:23.075 ************************************ 00:08:23.075 END TEST nvmf_filesystem_no_in_capsule 00:08:23.075 ************************************ 00:08:23.334 21:09:17 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:23.334 21:09:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:23.334 21:09:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:23.334 21:09:17 -- common/autotest_common.sh@10 -- # set +x 00:08:23.334 ************************************ 00:08:23.334 START TEST nvmf_filesystem_in_capsule 00:08:23.334 ************************************ 00:08:23.334 21:09:17 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:08:23.334 21:09:17 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:23.334 21:09:17 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:23.334 21:09:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:23.334 21:09:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:23.334 21:09:17 -- common/autotest_common.sh@10 -- # set +x 00:08:23.334 21:09:17 -- nvmf/common.sh@470 -- # nvmfpid=1193383 00:08:23.334 21:09:17 -- nvmf/common.sh@471 -- # waitforlisten 1193383 00:08:23.334 21:09:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:23.334 21:09:17 -- common/autotest_common.sh@817 -- # '[' -z 1193383 ']' 00:08:23.334 21:09:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:23.334 21:09:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:23.334 21:09:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:23.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:23.334 21:09:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:23.334 21:09:17 -- common/autotest_common.sh@10 -- # set +x 00:08:23.335 [2024-04-23 21:09:17.540579] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:08:23.335 [2024-04-23 21:09:17.540617] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:23.335 EAL: No free 2048 kB hugepages reported on node 1 00:08:23.335 [2024-04-23 21:09:17.591700] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:23.594 [2024-04-23 21:09:17.660032] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:23.594 [2024-04-23 21:09:17.660067] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:23.594 [2024-04-23 21:09:17.660073] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:23.594 [2024-04-23 21:09:17.660078] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:23.594 [2024-04-23 21:09:17.660083] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:23.594 [2024-04-23 21:09:17.660130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:23.594 [2024-04-23 21:09:17.660145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:23.594 [2024-04-23 21:09:17.660234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:23.594 [2024-04-23 21:09:17.660232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:24.162 21:09:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:24.162 21:09:18 -- common/autotest_common.sh@850 -- # return 0 00:08:24.162 21:09:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:24.162 21:09:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:24.162 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.162 21:09:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:24.162 21:09:18 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:24.162 21:09:18 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:08:24.162 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.162 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.162 [2024-04-23 21:09:18.377245] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xcfc6b0/0xd00ba0) succeed. 00:08:24.162 [2024-04-23 21:09:18.386663] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xcfdcf0/0xd42230) succeed. 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.422 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.422 Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:24.422 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.422 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.422 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:24.422 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.422 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.422 [2024-04-23 21:09:18.635135] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:24.422 21:09:18 -- common/autotest_common.sh@1366 -- # local bs 00:08:24.422 21:09:18 -- common/autotest_common.sh@1367 -- # local nb 00:08:24.422 21:09:18 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:24.422 21:09:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.422 21:09:18 -- common/autotest_common.sh@10 -- # set +x 00:08:24.422 21:09:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.422 21:09:18 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:24.422 { 00:08:24.422 "name": "Malloc1", 00:08:24.422 "aliases": [ 00:08:24.422 "5d202de4-cfd3-478d-a5f8-cfb0f68a7555" 00:08:24.422 ], 00:08:24.422 "product_name": "Malloc disk", 00:08:24.422 "block_size": 512, 00:08:24.422 "num_blocks": 1048576, 00:08:24.422 "uuid": "5d202de4-cfd3-478d-a5f8-cfb0f68a7555", 00:08:24.422 "assigned_rate_limits": { 00:08:24.422 "rw_ios_per_sec": 0, 00:08:24.422 "rw_mbytes_per_sec": 0, 00:08:24.422 "r_mbytes_per_sec": 0, 00:08:24.422 "w_mbytes_per_sec": 0 00:08:24.422 }, 00:08:24.422 "claimed": true, 00:08:24.422 "claim_type": "exclusive_write", 00:08:24.422 "zoned": false, 00:08:24.422 "supported_io_types": { 00:08:24.422 "read": true, 00:08:24.422 "write": true, 00:08:24.422 "unmap": true, 00:08:24.422 "write_zeroes": true, 00:08:24.422 "flush": true, 00:08:24.422 "reset": true, 00:08:24.422 "compare": false, 00:08:24.422 "compare_and_write": false, 00:08:24.422 "abort": true, 00:08:24.422 "nvme_admin": false, 00:08:24.422 "nvme_io": false 00:08:24.422 }, 00:08:24.422 "memory_domains": [ 00:08:24.422 { 00:08:24.422 "dma_device_id": "system", 00:08:24.422 "dma_device_type": 1 00:08:24.422 }, 00:08:24.422 { 00:08:24.422 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:24.422 "dma_device_type": 2 00:08:24.422 } 00:08:24.422 ], 00:08:24.422 "driver_specific": {} 00:08:24.422 } 00:08:24.422 ]' 00:08:24.422 21:09:18 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:24.681 21:09:18 -- common/autotest_common.sh@1369 -- # bs=512 00:08:24.681 21:09:18 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:24.681 21:09:18 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:24.681 21:09:18 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:24.681 21:09:18 -- common/autotest_common.sh@1374 -- # echo 512 00:08:24.681 21:09:18 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:24.681 21:09:18 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:25.616 21:09:19 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:25.616 21:09:19 -- common/autotest_common.sh@1184 -- # local i=0 00:08:25.616 21:09:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:25.616 21:09:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:25.616 21:09:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:27.517 21:09:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:27.517 21:09:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:27.517 21:09:21 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:27.517 21:09:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:27.517 21:09:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:27.518 21:09:21 -- common/autotest_common.sh@1194 -- # return 0 00:08:27.518 21:09:21 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:27.518 21:09:21 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:27.518 21:09:21 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:27.518 21:09:21 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:27.518 21:09:21 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:27.518 21:09:21 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:27.518 21:09:21 -- setup/common.sh@80 -- # echo 536870912 00:08:27.518 21:09:21 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:27.518 21:09:21 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:27.518 21:09:21 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:27.518 21:09:21 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:27.518 21:09:21 -- target/filesystem.sh@69 -- # partprobe 00:08:27.776 21:09:21 -- target/filesystem.sh@70 -- # sleep 1 00:08:28.711 21:09:22 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:28.711 21:09:22 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:28.711 21:09:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:28.711 21:09:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.711 21:09:22 -- common/autotest_common.sh@10 -- # set +x 00:08:28.970 ************************************ 00:08:28.970 START TEST filesystem_in_capsule_ext4 00:08:28.970 ************************************ 00:08:28.970 21:09:23 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:28.970 21:09:23 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:28.970 21:09:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:28.970 21:09:23 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:28.970 21:09:23 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:28.970 21:09:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:28.970 21:09:23 -- common/autotest_common.sh@914 -- # local i=0 00:08:28.970 21:09:23 -- common/autotest_common.sh@915 -- # local force 00:08:28.970 21:09:23 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:28.970 21:09:23 -- common/autotest_common.sh@918 -- # force=-F 00:08:28.970 21:09:23 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:28.970 mke2fs 1.46.5 (30-Dec-2021) 00:08:28.970 Discarding device blocks: 0/522240 done 00:08:28.970 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:28.970 Filesystem UUID: f79f814b-8278-44f6-be5c-ac82eebd14bb 00:08:28.970 Superblock backups stored on blocks: 00:08:28.970 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:28.970 00:08:28.970 Allocating group tables: 0/64 done 00:08:28.970 Writing inode tables: 0/64 done 00:08:28.970 Creating journal (8192 blocks): done 00:08:28.970 Writing superblocks and filesystem accounting information: 0/64 done 00:08:28.970 00:08:28.970 21:09:23 -- common/autotest_common.sh@931 -- # return 0 00:08:28.970 21:09:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:28.970 21:09:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:28.970 21:09:23 -- target/filesystem.sh@25 -- # sync 00:08:28.970 21:09:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:28.970 21:09:23 -- target/filesystem.sh@27 -- # sync 00:08:28.970 21:09:23 -- target/filesystem.sh@29 -- # i=0 00:08:28.970 21:09:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:28.970 21:09:23 -- target/filesystem.sh@37 -- # kill -0 1193383 00:08:28.970 21:09:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:28.970 21:09:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:28.970 21:09:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:28.970 21:09:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:28.970 00:08:28.970 real 0m0.171s 00:08:28.970 user 0m0.025s 00:08:28.970 sys 0m0.059s 00:08:28.970 21:09:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:28.970 21:09:23 -- common/autotest_common.sh@10 -- # set +x 00:08:28.970 ************************************ 00:08:28.970 END TEST filesystem_in_capsule_ext4 00:08:28.970 ************************************ 00:08:28.970 21:09:23 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:28.970 21:09:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:28.970 21:09:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.970 21:09:23 -- common/autotest_common.sh@10 -- # set +x 00:08:29.229 ************************************ 00:08:29.229 START TEST filesystem_in_capsule_btrfs 00:08:29.229 ************************************ 00:08:29.229 21:09:23 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:29.229 21:09:23 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:29.229 21:09:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.229 21:09:23 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:29.229 21:09:23 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:29.229 21:09:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:29.229 21:09:23 -- common/autotest_common.sh@914 -- # local i=0 00:08:29.229 21:09:23 -- common/autotest_common.sh@915 -- # local force 00:08:29.229 21:09:23 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:29.229 21:09:23 -- common/autotest_common.sh@920 -- # force=-f 00:08:29.229 21:09:23 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:29.229 btrfs-progs v6.6.2 00:08:29.229 See https://btrfs.readthedocs.io for more information. 00:08:29.229 00:08:29.229 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:29.229 NOTE: several default settings have changed in version 5.15, please make sure 00:08:29.229 this does not affect your deployments: 00:08:29.229 - DUP for metadata (-m dup) 00:08:29.229 - enabled no-holes (-O no-holes) 00:08:29.229 - enabled free-space-tree (-R free-space-tree) 00:08:29.229 00:08:29.229 Label: (null) 00:08:29.229 UUID: 989b2e20-4069-4ba1-ab18-d4e04a0229ec 00:08:29.229 Node size: 16384 00:08:29.229 Sector size: 4096 00:08:29.229 Filesystem size: 510.00MiB 00:08:29.229 Block group profiles: 00:08:29.229 Data: single 8.00MiB 00:08:29.229 Metadata: DUP 32.00MiB 00:08:29.229 System: DUP 8.00MiB 00:08:29.229 SSD detected: yes 00:08:29.229 Zoned device: no 00:08:29.229 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:29.229 Runtime features: free-space-tree 00:08:29.229 Checksum: crc32c 00:08:29.229 Number of devices: 1 00:08:29.229 Devices: 00:08:29.229 ID SIZE PATH 00:08:29.229 1 510.00MiB /dev/nvme0n1p1 00:08:29.229 00:08:29.229 21:09:23 -- common/autotest_common.sh@931 -- # return 0 00:08:29.229 21:09:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.488 21:09:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.488 21:09:23 -- target/filesystem.sh@25 -- # sync 00:08:29.488 21:09:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.488 21:09:23 -- target/filesystem.sh@27 -- # sync 00:08:29.488 21:09:23 -- target/filesystem.sh@29 -- # i=0 00:08:29.488 21:09:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.488 21:09:23 -- target/filesystem.sh@37 -- # kill -0 1193383 00:08:29.488 21:09:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.488 21:09:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.488 21:09:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.488 21:09:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.488 00:08:29.488 real 0m0.243s 00:08:29.488 user 0m0.030s 00:08:29.488 sys 0m0.114s 00:08:29.488 21:09:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:29.488 21:09:23 -- common/autotest_common.sh@10 -- # set +x 00:08:29.488 ************************************ 00:08:29.488 END TEST filesystem_in_capsule_btrfs 00:08:29.488 ************************************ 00:08:29.488 21:09:23 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:29.488 21:09:23 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:29.488 21:09:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.488 21:09:23 -- common/autotest_common.sh@10 -- # set +x 00:08:29.488 ************************************ 00:08:29.488 START TEST filesystem_in_capsule_xfs 00:08:29.488 ************************************ 00:08:29.488 21:09:23 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:29.488 21:09:23 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:29.488 21:09:23 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.488 21:09:23 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:29.488 21:09:23 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:29.488 21:09:23 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:29.488 21:09:23 -- common/autotest_common.sh@914 -- # local i=0 00:08:29.488 21:09:23 -- common/autotest_common.sh@915 -- # local force 00:08:29.488 21:09:23 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:29.488 21:09:23 -- common/autotest_common.sh@920 -- # force=-f 00:08:29.488 21:09:23 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:29.747 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:29.747 = sectsz=512 attr=2, projid32bit=1 00:08:29.747 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:29.747 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:29.747 data = bsize=4096 blocks=130560, imaxpct=25 00:08:29.747 = sunit=0 swidth=0 blks 00:08:29.747 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:29.747 log =internal log bsize=4096 blocks=16384, version=2 00:08:29.747 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:29.747 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:29.747 Discarding blocks...Done. 00:08:29.747 21:09:23 -- common/autotest_common.sh@931 -- # return 0 00:08:29.747 21:09:23 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.747 21:09:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.747 21:09:23 -- target/filesystem.sh@25 -- # sync 00:08:29.747 21:09:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.747 21:09:23 -- target/filesystem.sh@27 -- # sync 00:08:29.747 21:09:23 -- target/filesystem.sh@29 -- # i=0 00:08:29.747 21:09:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.747 21:09:23 -- target/filesystem.sh@37 -- # kill -0 1193383 00:08:29.747 21:09:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.747 21:09:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.748 21:09:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.748 21:09:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.748 00:08:29.748 real 0m0.180s 00:08:29.748 user 0m0.016s 00:08:29.748 sys 0m0.066s 00:08:29.748 21:09:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:29.748 21:09:23 -- common/autotest_common.sh@10 -- # set +x 00:08:29.748 ************************************ 00:08:29.748 END TEST filesystem_in_capsule_xfs 00:08:29.748 ************************************ 00:08:29.748 21:09:23 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:29.748 21:09:23 -- target/filesystem.sh@93 -- # sync 00:08:29.748 21:09:23 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:30.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.684 21:09:24 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:30.684 21:09:24 -- common/autotest_common.sh@1205 -- # local i=0 00:08:30.684 21:09:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:30.684 21:09:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:30.684 21:09:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:30.684 21:09:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:30.943 21:09:24 -- common/autotest_common.sh@1217 -- # return 0 00:08:30.943 21:09:24 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:30.943 21:09:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.943 21:09:24 -- common/autotest_common.sh@10 -- # set +x 00:08:30.943 21:09:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.943 21:09:24 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:30.943 21:09:24 -- target/filesystem.sh@101 -- # killprocess 1193383 00:08:30.943 21:09:24 -- common/autotest_common.sh@936 -- # '[' -z 1193383 ']' 00:08:30.943 21:09:24 -- common/autotest_common.sh@940 -- # kill -0 1193383 00:08:30.943 21:09:24 -- common/autotest_common.sh@941 -- # uname 00:08:30.943 21:09:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:30.943 21:09:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1193383 00:08:30.943 21:09:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:30.943 21:09:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:30.943 21:09:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1193383' 00:08:30.943 killing process with pid 1193383 00:08:30.943 21:09:25 -- common/autotest_common.sh@955 -- # kill 1193383 00:08:30.943 21:09:25 -- common/autotest_common.sh@960 -- # wait 1193383 00:08:30.943 [2024-04-23 21:09:25.093875] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:31.203 21:09:25 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:31.203 00:08:31.203 real 0m7.949s 00:08:31.203 user 0m31.110s 00:08:31.203 sys 0m1.155s 00:08:31.203 21:09:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:31.203 21:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:31.203 ************************************ 00:08:31.203 END TEST nvmf_filesystem_in_capsule 00:08:31.203 ************************************ 00:08:31.462 21:09:25 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:31.462 21:09:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:31.462 21:09:25 -- nvmf/common.sh@117 -- # sync 00:08:31.462 21:09:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:31.462 21:09:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:31.462 21:09:25 -- nvmf/common.sh@120 -- # set +e 00:08:31.462 21:09:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:31.462 21:09:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:31.462 rmmod nvme_rdma 00:08:31.462 rmmod nvme_fabrics 00:08:31.462 21:09:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:31.462 21:09:25 -- nvmf/common.sh@124 -- # set -e 00:08:31.462 21:09:25 -- nvmf/common.sh@125 -- # return 0 00:08:31.462 21:09:25 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:08:31.462 21:09:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:31.462 21:09:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:31.462 00:08:31.462 real 0m21.995s 00:08:31.462 user 1m4.001s 00:08:31.462 sys 0m6.725s 00:08:31.462 21:09:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:31.462 21:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:31.462 ************************************ 00:08:31.462 END TEST nvmf_filesystem 00:08:31.462 ************************************ 00:08:31.462 21:09:25 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:31.462 21:09:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:31.462 21:09:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:31.462 21:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:31.462 ************************************ 00:08:31.462 START TEST nvmf_discovery 00:08:31.462 ************************************ 00:08:31.462 21:09:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:31.722 * Looking for test storage... 00:08:31.722 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:31.722 21:09:25 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:31.722 21:09:25 -- nvmf/common.sh@7 -- # uname -s 00:08:31.722 21:09:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:31.722 21:09:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:31.722 21:09:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:31.722 21:09:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:31.722 21:09:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:31.722 21:09:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:31.722 21:09:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:31.722 21:09:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:31.722 21:09:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:31.722 21:09:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:31.722 21:09:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:31.723 21:09:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:31.723 21:09:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:31.723 21:09:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:31.723 21:09:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:31.723 21:09:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:31.723 21:09:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:31.723 21:09:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:31.723 21:09:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:31.723 21:09:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:31.723 21:09:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.723 21:09:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.723 21:09:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.723 21:09:25 -- paths/export.sh@5 -- # export PATH 00:08:31.723 21:09:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:31.723 21:09:25 -- nvmf/common.sh@47 -- # : 0 00:08:31.723 21:09:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:31.723 21:09:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:31.723 21:09:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:31.723 21:09:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:31.723 21:09:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:31.723 21:09:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:31.723 21:09:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:31.723 21:09:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:31.723 21:09:25 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:31.723 21:09:25 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:31.723 21:09:25 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:31.723 21:09:25 -- target/discovery.sh@15 -- # hash nvme 00:08:31.723 21:09:25 -- target/discovery.sh@20 -- # nvmftestinit 00:08:31.723 21:09:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:31.723 21:09:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:31.723 21:09:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:31.723 21:09:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:31.723 21:09:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:31.723 21:09:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:31.723 21:09:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:31.723 21:09:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:31.723 21:09:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:31.723 21:09:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:31.723 21:09:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:31.723 21:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:36.996 21:09:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:36.996 21:09:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:36.996 21:09:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:36.996 21:09:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:36.996 21:09:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:36.996 21:09:31 -- nvmf/common.sh@295 -- # net_devs=() 00:08:36.996 21:09:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@296 -- # e810=() 00:08:36.996 21:09:31 -- nvmf/common.sh@296 -- # local -ga e810 00:08:36.996 21:09:31 -- nvmf/common.sh@297 -- # x722=() 00:08:36.996 21:09:31 -- nvmf/common.sh@297 -- # local -ga x722 00:08:36.996 21:09:31 -- nvmf/common.sh@298 -- # mlx=() 00:08:36.996 21:09:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:36.996 21:09:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:36.996 21:09:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:36.996 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:36.996 21:09:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:36.996 21:09:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:36.996 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:36.996 21:09:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:36.996 21:09:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:36.996 21:09:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:36.996 21:09:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:36.996 Found net devices under 0000:18:00.0: mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:36.996 21:09:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:36.996 21:09:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:36.996 Found net devices under 0000:18:00.1: mlx_0_1 00:08:36.996 21:09:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:36.996 21:09:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:36.996 21:09:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:36.996 21:09:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:36.996 21:09:31 -- nvmf/common.sh@58 -- # uname 00:08:36.996 21:09:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:36.996 21:09:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:36.996 21:09:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:36.996 21:09:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:36.996 21:09:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:36.996 21:09:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:36.996 21:09:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:36.996 21:09:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:36.996 21:09:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:36.996 21:09:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:36.996 21:09:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:36.996 21:09:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:36.996 21:09:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:36.996 21:09:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@105 -- # continue 2 00:08:36.996 21:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:36.996 21:09:31 -- nvmf/common.sh@105 -- # continue 2 00:08:36.996 21:09:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:36.996 21:09:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:36.996 21:09:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:36.996 21:09:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:36.996 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:36.996 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:36.996 altname enp24s0f0np0 00:08:36.996 altname ens785f0np0 00:08:36.996 inet 192.168.100.8/24 scope global mlx_0_0 00:08:36.996 valid_lft forever preferred_lft forever 00:08:36.996 21:09:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:36.996 21:09:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:36.996 21:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:36.996 21:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:36.996 21:09:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:36.996 21:09:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:36.996 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:36.996 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:36.996 altname enp24s0f1np1 00:08:36.996 altname ens785f1np1 00:08:36.996 inet 192.168.100.9/24 scope global mlx_0_1 00:08:36.996 valid_lft forever preferred_lft forever 00:08:36.996 21:09:31 -- nvmf/common.sh@411 -- # return 0 00:08:36.996 21:09:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:36.996 21:09:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:36.996 21:09:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:36.996 21:09:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:36.996 21:09:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:36.996 21:09:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:36.996 21:09:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:36.996 21:09:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:36.996 21:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.996 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:36.996 21:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:36.996 21:09:31 -- nvmf/common.sh@105 -- # continue 2 00:08:36.996 21:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:36.997 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.997 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:36.997 21:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:36.997 21:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:36.997 21:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:36.997 21:09:31 -- nvmf/common.sh@105 -- # continue 2 00:08:36.997 21:09:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:36.997 21:09:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:36.997 21:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:36.997 21:09:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:36.997 21:09:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:36.997 21:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:36.997 21:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:36.997 21:09:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:36.997 192.168.100.9' 00:08:36.997 21:09:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:36.997 192.168.100.9' 00:08:36.997 21:09:31 -- nvmf/common.sh@446 -- # head -n 1 00:08:36.997 21:09:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:36.997 21:09:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:36.997 192.168.100.9' 00:08:36.997 21:09:31 -- nvmf/common.sh@447 -- # tail -n +2 00:08:36.997 21:09:31 -- nvmf/common.sh@447 -- # head -n 1 00:08:36.997 21:09:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:36.997 21:09:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:36.997 21:09:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:36.997 21:09:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:36.997 21:09:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:36.997 21:09:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:36.997 21:09:31 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:36.997 21:09:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:36.997 21:09:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:36.997 21:09:31 -- common/autotest_common.sh@10 -- # set +x 00:08:36.997 21:09:31 -- nvmf/common.sh@470 -- # nvmfpid=1198205 00:08:36.997 21:09:31 -- nvmf/common.sh@471 -- # waitforlisten 1198205 00:08:36.997 21:09:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:36.997 21:09:31 -- common/autotest_common.sh@817 -- # '[' -z 1198205 ']' 00:08:36.997 21:09:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:36.997 21:09:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:36.997 21:09:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:36.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:36.997 21:09:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:36.997 21:09:31 -- common/autotest_common.sh@10 -- # set +x 00:08:37.257 [2024-04-23 21:09:31.270912] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:08:37.258 [2024-04-23 21:09:31.270954] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:37.258 EAL: No free 2048 kB hugepages reported on node 1 00:08:37.258 [2024-04-23 21:09:31.322431] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:37.258 [2024-04-23 21:09:31.387549] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:37.258 [2024-04-23 21:09:31.387589] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:37.258 [2024-04-23 21:09:31.387595] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:37.258 [2024-04-23 21:09:31.387600] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:37.258 [2024-04-23 21:09:31.387604] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:37.258 [2024-04-23 21:09:31.387672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:37.258 [2024-04-23 21:09:31.387761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:37.258 [2024-04-23 21:09:31.387846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:37.258 [2024-04-23 21:09:31.387847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:37.868 21:09:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:37.868 21:09:32 -- common/autotest_common.sh@850 -- # return 0 00:08:37.869 21:09:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:37.869 21:09:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:37.869 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:37.869 21:09:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:37.869 21:09:32 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:37.869 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:37.869 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:37.869 [2024-04-23 21:09:32.117611] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22f56b0/0x22f9ba0) succeed. 00:08:37.869 [2024-04-23 21:09:32.127398] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22f6cf0/0x233b230) succeed. 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@26 -- # seq 1 4 00:08:38.128 21:09:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:38.128 21:09:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 Null1 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 [2024-04-23 21:09:32.275364] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:38.128 21:09:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 Null2 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:38.128 21:09:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:38.128 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.128 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.128 Null3 00:08:38.128 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.128 21:09:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:38.129 21:09:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 Null4 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:08:38.129 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.129 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.129 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.129 21:09:32 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:08:38.388 00:08:38.388 Discovery Log Number of Records 6, Generation counter 6 00:08:38.388 =====Discovery Log Entry 0====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: current discovery subsystem 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4420 00:08:38.388 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: explicit discovery connections, duplicate discovery information 00:08:38.388 rdma_prtype: not specified 00:08:38.388 rdma_qptype: connected 00:08:38.388 rdma_cms: rdma-cm 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 =====Discovery Log Entry 1====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: nvme subsystem 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4420 00:08:38.388 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: none 00:08:38.388 rdma_prtype: not specified 00:08:38.388 rdma_qptype: connected 00:08:38.388 rdma_cms: rdma-cm 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 =====Discovery Log Entry 2====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: nvme subsystem 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4420 00:08:38.388 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: none 00:08:38.388 rdma_prtype: not specified 00:08:38.388 rdma_qptype: connected 00:08:38.388 rdma_cms: rdma-cm 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 =====Discovery Log Entry 3====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: nvme subsystem 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4420 00:08:38.388 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: none 00:08:38.388 rdma_prtype: not specified 00:08:38.388 rdma_qptype: connected 00:08:38.388 rdma_cms: rdma-cm 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 =====Discovery Log Entry 4====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: nvme subsystem 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4420 00:08:38.388 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: none 00:08:38.388 rdma_prtype: not specified 00:08:38.388 rdma_qptype: connected 00:08:38.388 rdma_cms: rdma-cm 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 =====Discovery Log Entry 5====== 00:08:38.388 trtype: rdma 00:08:38.388 adrfam: ipv4 00:08:38.388 subtype: discovery subsystem referral 00:08:38.388 treq: not required 00:08:38.388 portid: 0 00:08:38.388 trsvcid: 4430 00:08:38.388 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:38.388 traddr: 192.168.100.8 00:08:38.388 eflags: none 00:08:38.388 rdma_prtype: unrecognized 00:08:38.388 rdma_qptype: unrecognized 00:08:38.388 rdma_cms: unrecognized 00:08:38.388 rdma_pkey: 0x0000 00:08:38.388 21:09:32 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:38.388 Perform nvmf subsystem discovery via RPC 00:08:38.388 21:09:32 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:38.388 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.388 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.388 [2024-04-23 21:09:32.487805] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:38.388 [ 00:08:38.388 { 00:08:38.388 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:38.388 "subtype": "Discovery", 00:08:38.388 "listen_addresses": [ 00:08:38.388 { 00:08:38.388 "transport": "RDMA", 00:08:38.388 "trtype": "RDMA", 00:08:38.388 "adrfam": "IPv4", 00:08:38.388 "traddr": "192.168.100.8", 00:08:38.388 "trsvcid": "4420" 00:08:38.388 } 00:08:38.388 ], 00:08:38.388 "allow_any_host": true, 00:08:38.388 "hosts": [] 00:08:38.388 }, 00:08:38.388 { 00:08:38.388 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:38.388 "subtype": "NVMe", 00:08:38.388 "listen_addresses": [ 00:08:38.388 { 00:08:38.388 "transport": "RDMA", 00:08:38.388 "trtype": "RDMA", 00:08:38.388 "adrfam": "IPv4", 00:08:38.388 "traddr": "192.168.100.8", 00:08:38.388 "trsvcid": "4420" 00:08:38.388 } 00:08:38.388 ], 00:08:38.388 "allow_any_host": true, 00:08:38.388 "hosts": [], 00:08:38.388 "serial_number": "SPDK00000000000001", 00:08:38.388 "model_number": "SPDK bdev Controller", 00:08:38.388 "max_namespaces": 32, 00:08:38.388 "min_cntlid": 1, 00:08:38.388 "max_cntlid": 65519, 00:08:38.388 "namespaces": [ 00:08:38.388 { 00:08:38.388 "nsid": 1, 00:08:38.388 "bdev_name": "Null1", 00:08:38.388 "name": "Null1", 00:08:38.388 "nguid": "28209401458540558BED2B2F6D294D38", 00:08:38.388 "uuid": "28209401-4585-4055-8bed-2b2f6d294d38" 00:08:38.388 } 00:08:38.388 ] 00:08:38.388 }, 00:08:38.388 { 00:08:38.388 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:38.388 "subtype": "NVMe", 00:08:38.388 "listen_addresses": [ 00:08:38.388 { 00:08:38.388 "transport": "RDMA", 00:08:38.388 "trtype": "RDMA", 00:08:38.388 "adrfam": "IPv4", 00:08:38.388 "traddr": "192.168.100.8", 00:08:38.388 "trsvcid": "4420" 00:08:38.388 } 00:08:38.388 ], 00:08:38.388 "allow_any_host": true, 00:08:38.388 "hosts": [], 00:08:38.388 "serial_number": "SPDK00000000000002", 00:08:38.388 "model_number": "SPDK bdev Controller", 00:08:38.388 "max_namespaces": 32, 00:08:38.388 "min_cntlid": 1, 00:08:38.388 "max_cntlid": 65519, 00:08:38.388 "namespaces": [ 00:08:38.388 { 00:08:38.388 "nsid": 1, 00:08:38.388 "bdev_name": "Null2", 00:08:38.388 "name": "Null2", 00:08:38.389 "nguid": "22BD6612B0D346008B7B5C7259771D4C", 00:08:38.389 "uuid": "22bd6612-b0d3-4600-8b7b-5c7259771d4c" 00:08:38.389 } 00:08:38.389 ] 00:08:38.389 }, 00:08:38.389 { 00:08:38.389 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:38.389 "subtype": "NVMe", 00:08:38.389 "listen_addresses": [ 00:08:38.389 { 00:08:38.389 "transport": "RDMA", 00:08:38.389 "trtype": "RDMA", 00:08:38.389 "adrfam": "IPv4", 00:08:38.389 "traddr": "192.168.100.8", 00:08:38.389 "trsvcid": "4420" 00:08:38.389 } 00:08:38.389 ], 00:08:38.389 "allow_any_host": true, 00:08:38.389 "hosts": [], 00:08:38.389 "serial_number": "SPDK00000000000003", 00:08:38.389 "model_number": "SPDK bdev Controller", 00:08:38.389 "max_namespaces": 32, 00:08:38.389 "min_cntlid": 1, 00:08:38.389 "max_cntlid": 65519, 00:08:38.389 "namespaces": [ 00:08:38.389 { 00:08:38.389 "nsid": 1, 00:08:38.389 "bdev_name": "Null3", 00:08:38.389 "name": "Null3", 00:08:38.389 "nguid": "7B8D8ECC5EEC4FE19DFC06A970D09D62", 00:08:38.389 "uuid": "7b8d8ecc-5eec-4fe1-9dfc-06a970d09d62" 00:08:38.389 } 00:08:38.389 ] 00:08:38.389 }, 00:08:38.389 { 00:08:38.389 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:38.389 "subtype": "NVMe", 00:08:38.389 "listen_addresses": [ 00:08:38.389 { 00:08:38.389 "transport": "RDMA", 00:08:38.389 "trtype": "RDMA", 00:08:38.389 "adrfam": "IPv4", 00:08:38.389 "traddr": "192.168.100.8", 00:08:38.389 "trsvcid": "4420" 00:08:38.389 } 00:08:38.389 ], 00:08:38.389 "allow_any_host": true, 00:08:38.389 "hosts": [], 00:08:38.389 "serial_number": "SPDK00000000000004", 00:08:38.389 "model_number": "SPDK bdev Controller", 00:08:38.389 "max_namespaces": 32, 00:08:38.389 "min_cntlid": 1, 00:08:38.389 "max_cntlid": 65519, 00:08:38.389 "namespaces": [ 00:08:38.389 { 00:08:38.389 "nsid": 1, 00:08:38.389 "bdev_name": "Null4", 00:08:38.389 "name": "Null4", 00:08:38.389 "nguid": "09CC30DFD2D84CD0A71F75B40778FF28", 00:08:38.389 "uuid": "09cc30df-d2d8-4cd0-a71f-75b40778ff28" 00:08:38.389 } 00:08:38.389 ] 00:08:38.389 } 00:08:38.389 ] 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@42 -- # seq 1 4 00:08:38.389 21:09:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:38.389 21:09:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:38.389 21:09:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:38.389 21:09:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:38.389 21:09:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:38.389 21:09:32 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:38.389 21:09:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.389 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.389 21:09:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:38.389 21:09:32 -- target/discovery.sh@49 -- # check_bdevs= 00:08:38.389 21:09:32 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:38.389 21:09:32 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:38.389 21:09:32 -- target/discovery.sh@57 -- # nvmftestfini 00:08:38.389 21:09:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:38.389 21:09:32 -- nvmf/common.sh@117 -- # sync 00:08:38.389 21:09:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:38.389 21:09:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:38.389 21:09:32 -- nvmf/common.sh@120 -- # set +e 00:08:38.389 21:09:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:38.389 21:09:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:38.389 rmmod nvme_rdma 00:08:38.389 rmmod nvme_fabrics 00:08:38.648 21:09:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:38.648 21:09:32 -- nvmf/common.sh@124 -- # set -e 00:08:38.648 21:09:32 -- nvmf/common.sh@125 -- # return 0 00:08:38.648 21:09:32 -- nvmf/common.sh@478 -- # '[' -n 1198205 ']' 00:08:38.648 21:09:32 -- nvmf/common.sh@479 -- # killprocess 1198205 00:08:38.648 21:09:32 -- common/autotest_common.sh@936 -- # '[' -z 1198205 ']' 00:08:38.648 21:09:32 -- common/autotest_common.sh@940 -- # kill -0 1198205 00:08:38.648 21:09:32 -- common/autotest_common.sh@941 -- # uname 00:08:38.648 21:09:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:38.648 21:09:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1198205 00:08:38.648 21:09:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:38.648 21:09:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:38.648 21:09:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1198205' 00:08:38.648 killing process with pid 1198205 00:08:38.648 21:09:32 -- common/autotest_common.sh@955 -- # kill 1198205 00:08:38.649 [2024-04-23 21:09:32.726504] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:38.649 21:09:32 -- common/autotest_common.sh@960 -- # wait 1198205 00:08:38.649 [2024-04-23 21:09:32.799508] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:38.908 21:09:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:38.908 21:09:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:38.908 00:08:38.908 real 0m7.332s 00:08:38.908 user 0m7.925s 00:08:38.908 sys 0m4.525s 00:08:38.908 21:09:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:38.908 21:09:32 -- common/autotest_common.sh@10 -- # set +x 00:08:38.908 ************************************ 00:08:38.908 END TEST nvmf_discovery 00:08:38.908 ************************************ 00:08:38.908 21:09:33 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:38.908 21:09:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:38.908 21:09:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.908 21:09:33 -- common/autotest_common.sh@10 -- # set +x 00:08:38.908 ************************************ 00:08:38.908 START TEST nvmf_referrals 00:08:38.908 ************************************ 00:08:38.908 21:09:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:39.167 * Looking for test storage... 00:08:39.167 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:39.167 21:09:33 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:39.167 21:09:33 -- nvmf/common.sh@7 -- # uname -s 00:08:39.167 21:09:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:39.167 21:09:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:39.167 21:09:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:39.167 21:09:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:39.167 21:09:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:39.167 21:09:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:39.167 21:09:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:39.167 21:09:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:39.167 21:09:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:39.167 21:09:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:39.167 21:09:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:39.167 21:09:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:39.167 21:09:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:39.167 21:09:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:39.167 21:09:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:39.167 21:09:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:39.167 21:09:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:39.167 21:09:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:39.167 21:09:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:39.167 21:09:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:39.167 21:09:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.168 21:09:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.168 21:09:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.168 21:09:33 -- paths/export.sh@5 -- # export PATH 00:08:39.168 21:09:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:39.168 21:09:33 -- nvmf/common.sh@47 -- # : 0 00:08:39.168 21:09:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:39.168 21:09:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:39.168 21:09:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:39.168 21:09:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:39.168 21:09:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:39.168 21:09:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:39.168 21:09:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:39.168 21:09:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:39.168 21:09:33 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:39.168 21:09:33 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:39.168 21:09:33 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:39.168 21:09:33 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:39.168 21:09:33 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:39.168 21:09:33 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:39.168 21:09:33 -- target/referrals.sh@37 -- # nvmftestinit 00:08:39.168 21:09:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:39.168 21:09:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:39.168 21:09:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:39.168 21:09:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:39.168 21:09:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:39.168 21:09:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:39.168 21:09:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:39.168 21:09:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:39.168 21:09:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:39.168 21:09:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:39.168 21:09:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:39.168 21:09:33 -- common/autotest_common.sh@10 -- # set +x 00:08:44.445 21:09:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:44.445 21:09:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:44.445 21:09:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:44.445 21:09:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:44.445 21:09:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:44.445 21:09:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:44.445 21:09:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:44.445 21:09:38 -- nvmf/common.sh@295 -- # net_devs=() 00:08:44.445 21:09:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:44.445 21:09:38 -- nvmf/common.sh@296 -- # e810=() 00:08:44.445 21:09:38 -- nvmf/common.sh@296 -- # local -ga e810 00:08:44.445 21:09:38 -- nvmf/common.sh@297 -- # x722=() 00:08:44.445 21:09:38 -- nvmf/common.sh@297 -- # local -ga x722 00:08:44.445 21:09:38 -- nvmf/common.sh@298 -- # mlx=() 00:08:44.445 21:09:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:44.445 21:09:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:44.445 21:09:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:44.445 21:09:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:44.445 21:09:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:44.445 21:09:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:44.445 21:09:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:44.445 21:09:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:44.445 21:09:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:44.445 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:44.445 21:09:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:44.445 21:09:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:44.445 21:09:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:44.445 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:44.445 21:09:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:44.445 21:09:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:44.445 21:09:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:44.445 21:09:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:44.445 21:09:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.445 21:09:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:44.445 21:09:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.445 21:09:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:44.445 Found net devices under 0000:18:00.0: mlx_0_0 00:08:44.445 21:09:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.445 21:09:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:44.445 21:09:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.445 21:09:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:44.446 21:09:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.446 21:09:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:44.446 Found net devices under 0000:18:00.1: mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.446 21:09:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:44.446 21:09:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:44.446 21:09:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:44.446 21:09:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:44.446 21:09:38 -- nvmf/common.sh@58 -- # uname 00:08:44.446 21:09:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:44.446 21:09:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:44.446 21:09:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:44.446 21:09:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:44.446 21:09:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:44.446 21:09:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:44.446 21:09:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:44.446 21:09:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:44.446 21:09:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:44.446 21:09:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:44.446 21:09:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:44.446 21:09:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:44.446 21:09:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:44.446 21:09:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:44.446 21:09:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:44.446 21:09:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:44.446 21:09:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@105 -- # continue 2 00:08:44.446 21:09:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@105 -- # continue 2 00:08:44.446 21:09:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:44.446 21:09:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:44.446 21:09:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:44.446 21:09:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:44.446 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:44.446 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:44.446 altname enp24s0f0np0 00:08:44.446 altname ens785f0np0 00:08:44.446 inet 192.168.100.8/24 scope global mlx_0_0 00:08:44.446 valid_lft forever preferred_lft forever 00:08:44.446 21:09:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:44.446 21:09:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:44.446 21:09:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:44.446 21:09:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:44.446 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:44.446 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:44.446 altname enp24s0f1np1 00:08:44.446 altname ens785f1np1 00:08:44.446 inet 192.168.100.9/24 scope global mlx_0_1 00:08:44.446 valid_lft forever preferred_lft forever 00:08:44.446 21:09:38 -- nvmf/common.sh@411 -- # return 0 00:08:44.446 21:09:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:44.446 21:09:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:44.446 21:09:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:44.446 21:09:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:44.446 21:09:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:44.446 21:09:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:44.446 21:09:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:44.446 21:09:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:44.446 21:09:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:44.446 21:09:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@105 -- # continue 2 00:08:44.446 21:09:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:44.446 21:09:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:44.446 21:09:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@105 -- # continue 2 00:08:44.446 21:09:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:44.446 21:09:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:44.446 21:09:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:44.446 21:09:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:44.446 21:09:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:44.446 21:09:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:44.446 192.168.100.9' 00:08:44.446 21:09:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:44.446 192.168.100.9' 00:08:44.446 21:09:38 -- nvmf/common.sh@446 -- # head -n 1 00:08:44.446 21:09:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:44.446 21:09:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:44.446 192.168.100.9' 00:08:44.446 21:09:38 -- nvmf/common.sh@447 -- # tail -n +2 00:08:44.446 21:09:38 -- nvmf/common.sh@447 -- # head -n 1 00:08:44.446 21:09:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:44.446 21:09:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:44.446 21:09:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:44.446 21:09:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:44.446 21:09:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:44.446 21:09:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:44.446 21:09:38 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:44.446 21:09:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:44.446 21:09:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:44.446 21:09:38 -- common/autotest_common.sh@10 -- # set +x 00:08:44.446 21:09:38 -- nvmf/common.sh@470 -- # nvmfpid=1201753 00:08:44.446 21:09:38 -- nvmf/common.sh@471 -- # waitforlisten 1201753 00:08:44.446 21:09:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:44.446 21:09:38 -- common/autotest_common.sh@817 -- # '[' -z 1201753 ']' 00:08:44.446 21:09:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:44.446 21:09:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:44.446 21:09:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:44.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:44.446 21:09:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:44.446 21:09:38 -- common/autotest_common.sh@10 -- # set +x 00:08:44.706 [2024-04-23 21:09:38.741303] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:08:44.706 [2024-04-23 21:09:38.741357] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:44.706 EAL: No free 2048 kB hugepages reported on node 1 00:08:44.706 [2024-04-23 21:09:38.792998] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:44.706 [2024-04-23 21:09:38.867059] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:44.706 [2024-04-23 21:09:38.867093] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:44.706 [2024-04-23 21:09:38.867100] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:44.706 [2024-04-23 21:09:38.867105] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:44.706 [2024-04-23 21:09:38.867109] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:44.706 [2024-04-23 21:09:38.867167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:44.706 [2024-04-23 21:09:38.867258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:44.706 [2024-04-23 21:09:38.867342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:44.706 [2024-04-23 21:09:38.867344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.273 21:09:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:45.273 21:09:39 -- common/autotest_common.sh@850 -- # return 0 00:08:45.273 21:09:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:45.273 21:09:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:45.273 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.531 21:09:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:45.531 21:09:39 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:45.531 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.531 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.531 [2024-04-23 21:09:39.584289] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x78d6b0/0x791ba0) succeed. 00:08:45.531 [2024-04-23 21:09:39.593512] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x78ecf0/0x7d3230) succeed. 00:08:45.531 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.531 21:09:39 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:08:45.531 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.531 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.531 [2024-04-23 21:09:39.709249] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.532 21:09:39 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:08:45.532 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.532 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.532 21:09:39 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:08:45.532 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.532 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.532 21:09:39 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:08:45.532 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.532 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.532 21:09:39 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.532 21:09:39 -- target/referrals.sh@48 -- # jq length 00:08:45.532 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.532 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.532 21:09:39 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:45.532 21:09:39 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:45.532 21:09:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:45.532 21:09:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.532 21:09:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:45.532 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.532 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.532 21:09:39 -- target/referrals.sh@21 -- # sort 00:08:45.532 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:45.791 21:09:39 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:45.791 21:09:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:45.791 21:09:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # sort 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:45.791 21:09:39 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:08:45.791 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.791 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.791 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:08:45.791 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.791 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.791 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:08:45.791 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.791 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.791 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@56 -- # jq length 00:08:45.791 21:09:39 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.791 21:09:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.791 21:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:45.791 21:09:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.791 21:09:39 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:45.791 21:09:39 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:45.791 21:09:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:45.791 21:09:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:45.791 21:09:39 -- target/referrals.sh@26 -- # sort 00:08:46.050 21:09:40 -- target/referrals.sh@26 -- # echo 00:08:46.050 21:09:40 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:46.050 21:09:40 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:08:46.050 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.050 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.050 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.050 21:09:40 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.050 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.050 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.050 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.050 21:09:40 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:46.050 21:09:40 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.050 21:09:40 -- target/referrals.sh@21 -- # sort 00:08:46.050 21:09:40 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.050 21:09:40 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.050 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.050 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.050 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.050 21:09:40 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:46.050 21:09:40 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.050 21:09:40 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:46.050 21:09:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.050 21:09:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.050 21:09:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.050 21:09:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.050 21:09:40 -- target/referrals.sh@26 -- # sort 00:08:46.050 21:09:40 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:46.050 21:09:40 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.050 21:09:40 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:46.050 21:09:40 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:46.050 21:09:40 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:46.050 21:09:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.050 21:09:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:46.309 21:09:40 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:46.309 21:09:40 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:46.309 21:09:40 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:46.309 21:09:40 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:46.309 21:09:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.309 21:09:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:46.309 21:09:40 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:46.309 21:09:40 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.309 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.309 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.309 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.309 21:09:40 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:46.309 21:09:40 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.309 21:09:40 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.309 21:09:40 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.309 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.309 21:09:40 -- target/referrals.sh@21 -- # sort 00:08:46.309 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.309 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.309 21:09:40 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:46.309 21:09:40 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:46.309 21:09:40 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:46.309 21:09:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.309 21:09:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.309 21:09:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.309 21:09:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.309 21:09:40 -- target/referrals.sh@26 -- # sort 00:08:46.568 21:09:40 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:46.568 21:09:40 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:46.568 21:09:40 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:46.568 21:09:40 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:46.568 21:09:40 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:46.568 21:09:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.568 21:09:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:46.568 21:09:40 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:46.568 21:09:40 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:46.568 21:09:40 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:46.568 21:09:40 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:46.568 21:09:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.568 21:09:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:46.568 21:09:40 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:46.568 21:09:40 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:46.568 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.568 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.568 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.568 21:09:40 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.568 21:09:40 -- target/referrals.sh@82 -- # jq length 00:08:46.568 21:09:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:46.568 21:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:46.568 21:09:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:46.568 21:09:40 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:46.568 21:09:40 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:46.568 21:09:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.568 21:09:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.568 21:09:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:46.568 21:09:40 -- target/referrals.sh@26 -- # sort 00:08:46.827 21:09:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.827 21:09:40 -- target/referrals.sh@26 -- # echo 00:08:46.827 21:09:40 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:46.827 21:09:40 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:46.827 21:09:40 -- target/referrals.sh@86 -- # nvmftestfini 00:08:46.827 21:09:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:46.827 21:09:40 -- nvmf/common.sh@117 -- # sync 00:08:46.827 21:09:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:46.827 21:09:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:46.827 21:09:40 -- nvmf/common.sh@120 -- # set +e 00:08:46.827 21:09:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:46.827 21:09:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:46.827 rmmod nvme_rdma 00:08:46.827 rmmod nvme_fabrics 00:08:46.827 21:09:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:46.827 21:09:40 -- nvmf/common.sh@124 -- # set -e 00:08:46.827 21:09:40 -- nvmf/common.sh@125 -- # return 0 00:08:46.827 21:09:40 -- nvmf/common.sh@478 -- # '[' -n 1201753 ']' 00:08:46.827 21:09:40 -- nvmf/common.sh@479 -- # killprocess 1201753 00:08:46.827 21:09:40 -- common/autotest_common.sh@936 -- # '[' -z 1201753 ']' 00:08:46.827 21:09:40 -- common/autotest_common.sh@940 -- # kill -0 1201753 00:08:46.827 21:09:40 -- common/autotest_common.sh@941 -- # uname 00:08:46.827 21:09:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:46.827 21:09:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1201753 00:08:46.827 21:09:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:46.827 21:09:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:46.827 21:09:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1201753' 00:08:46.827 killing process with pid 1201753 00:08:46.827 21:09:41 -- common/autotest_common.sh@955 -- # kill 1201753 00:08:46.827 21:09:41 -- common/autotest_common.sh@960 -- # wait 1201753 00:08:46.827 [2024-04-23 21:09:41.083516] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:47.086 21:09:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:47.086 21:09:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:47.086 00:08:47.086 real 0m8.122s 00:08:47.086 user 0m11.737s 00:08:47.086 sys 0m4.828s 00:08:47.086 21:09:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:47.086 21:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:47.086 ************************************ 00:08:47.086 END TEST nvmf_referrals 00:08:47.086 ************************************ 00:08:47.086 21:09:41 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:47.086 21:09:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:47.086 21:09:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.086 21:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:47.346 ************************************ 00:08:47.346 START TEST nvmf_connect_disconnect 00:08:47.346 ************************************ 00:08:47.346 21:09:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:47.346 * Looking for test storage... 00:08:47.346 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:47.346 21:09:41 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:47.346 21:09:41 -- nvmf/common.sh@7 -- # uname -s 00:08:47.346 21:09:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:47.346 21:09:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:47.346 21:09:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:47.346 21:09:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:47.346 21:09:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:47.346 21:09:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:47.346 21:09:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:47.346 21:09:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:47.346 21:09:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:47.346 21:09:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:47.346 21:09:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:47.346 21:09:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:47.346 21:09:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:47.346 21:09:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:47.346 21:09:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:47.346 21:09:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:47.346 21:09:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:47.346 21:09:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:47.346 21:09:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:47.346 21:09:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:47.346 21:09:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.346 21:09:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.346 21:09:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.346 21:09:41 -- paths/export.sh@5 -- # export PATH 00:08:47.346 21:09:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.346 21:09:41 -- nvmf/common.sh@47 -- # : 0 00:08:47.346 21:09:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:47.346 21:09:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:47.346 21:09:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:47.346 21:09:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:47.346 21:09:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:47.346 21:09:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:47.346 21:09:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:47.346 21:09:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:47.346 21:09:41 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:47.346 21:09:41 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:47.346 21:09:41 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:47.346 21:09:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:47.346 21:09:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:47.347 21:09:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:47.347 21:09:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:47.347 21:09:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:47.347 21:09:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.347 21:09:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.347 21:09:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:47.347 21:09:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:47.347 21:09:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:47.347 21:09:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:47.347 21:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:52.628 21:09:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:52.628 21:09:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:52.628 21:09:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:52.628 21:09:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:52.628 21:09:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:52.628 21:09:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:52.628 21:09:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:52.628 21:09:46 -- nvmf/common.sh@295 -- # net_devs=() 00:08:52.628 21:09:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:52.628 21:09:46 -- nvmf/common.sh@296 -- # e810=() 00:08:52.628 21:09:46 -- nvmf/common.sh@296 -- # local -ga e810 00:08:52.628 21:09:46 -- nvmf/common.sh@297 -- # x722=() 00:08:52.628 21:09:46 -- nvmf/common.sh@297 -- # local -ga x722 00:08:52.628 21:09:46 -- nvmf/common.sh@298 -- # mlx=() 00:08:52.628 21:09:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:52.628 21:09:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:52.628 21:09:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:52.628 21:09:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:52.628 21:09:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:52.628 21:09:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:52.628 21:09:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:52.628 21:09:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:52.628 21:09:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:52.628 21:09:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:52.628 21:09:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:52.628 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:52.628 21:09:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:52.628 21:09:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:52.628 21:09:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:52.628 21:09:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:52.629 21:09:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:52.629 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:52.629 21:09:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:52.629 21:09:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.629 21:09:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.629 21:09:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:52.629 Found net devices under 0000:18:00.0: mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.629 21:09:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.629 21:09:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.629 21:09:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:52.629 Found net devices under 0000:18:00.1: mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.629 21:09:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:52.629 21:09:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:52.629 21:09:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:52.629 21:09:46 -- nvmf/common.sh@58 -- # uname 00:08:52.629 21:09:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:52.629 21:09:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:52.629 21:09:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:52.629 21:09:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:52.629 21:09:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:52.629 21:09:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:52.629 21:09:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:52.629 21:09:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:52.629 21:09:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:52.629 21:09:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:52.629 21:09:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:52.629 21:09:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:52.629 21:09:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:52.629 21:09:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:52.629 21:09:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:52.629 21:09:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@105 -- # continue 2 00:08:52.629 21:09:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@105 -- # continue 2 00:08:52.629 21:09:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:52.629 21:09:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.629 21:09:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:52.629 21:09:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:52.629 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:52.629 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:52.629 altname enp24s0f0np0 00:08:52.629 altname ens785f0np0 00:08:52.629 inet 192.168.100.8/24 scope global mlx_0_0 00:08:52.629 valid_lft forever preferred_lft forever 00:08:52.629 21:09:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:52.629 21:09:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.629 21:09:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:52.629 21:09:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:52.629 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:52.629 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:52.629 altname enp24s0f1np1 00:08:52.629 altname ens785f1np1 00:08:52.629 inet 192.168.100.9/24 scope global mlx_0_1 00:08:52.629 valid_lft forever preferred_lft forever 00:08:52.629 21:09:46 -- nvmf/common.sh@411 -- # return 0 00:08:52.629 21:09:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:52.629 21:09:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:52.629 21:09:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:52.629 21:09:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:52.629 21:09:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:52.629 21:09:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:52.629 21:09:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:52.629 21:09:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:52.629 21:09:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:52.629 21:09:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@105 -- # continue 2 00:08:52.629 21:09:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.629 21:09:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:52.629 21:09:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@105 -- # continue 2 00:08:52.629 21:09:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:52.629 21:09:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.629 21:09:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:52.629 21:09:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.629 21:09:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.629 21:09:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:52.629 192.168.100.9' 00:08:52.629 21:09:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:52.629 192.168.100.9' 00:08:52.629 21:09:46 -- nvmf/common.sh@446 -- # head -n 1 00:08:52.629 21:09:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:52.629 21:09:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:52.629 192.168.100.9' 00:08:52.629 21:09:46 -- nvmf/common.sh@447 -- # tail -n +2 00:08:52.629 21:09:46 -- nvmf/common.sh@447 -- # head -n 1 00:08:52.629 21:09:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:52.629 21:09:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:52.629 21:09:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:52.629 21:09:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:52.629 21:09:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:52.629 21:09:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:52.629 21:09:46 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:52.629 21:09:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:52.629 21:09:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:52.629 21:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:52.629 21:09:46 -- nvmf/common.sh@470 -- # nvmfpid=1205620 00:08:52.629 21:09:46 -- nvmf/common.sh@471 -- # waitforlisten 1205620 00:08:52.629 21:09:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:52.629 21:09:46 -- common/autotest_common.sh@817 -- # '[' -z 1205620 ']' 00:08:52.629 21:09:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:52.629 21:09:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:52.629 21:09:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:52.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:52.629 21:09:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:52.629 21:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:52.630 [2024-04-23 21:09:46.872931] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:08:52.630 [2024-04-23 21:09:46.872978] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:52.630 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.889 [2024-04-23 21:09:46.925933] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.889 [2024-04-23 21:09:46.994102] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.889 [2024-04-23 21:09:46.994143] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.889 [2024-04-23 21:09:46.994149] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:52.889 [2024-04-23 21:09:46.994154] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:52.889 [2024-04-23 21:09:46.994158] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.889 [2024-04-23 21:09:46.994224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.889 [2024-04-23 21:09:46.994309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.889 [2024-04-23 21:09:46.994359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.889 [2024-04-23 21:09:46.994357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:53.457 21:09:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:53.457 21:09:47 -- common/autotest_common.sh@850 -- # return 0 00:08:53.457 21:09:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:53.457 21:09:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:53.457 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.457 21:09:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.457 21:09:47 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:53.457 21:09:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.457 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.457 [2024-04-23 21:09:47.696947] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:53.457 [2024-04-23 21:09:47.716436] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xced6b0/0xcf1ba0) succeed. 00:08:53.457 [2024-04-23 21:09:47.725802] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xceecf0/0xd33230) succeed. 00:08:53.716 21:09:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.716 21:09:47 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:53.716 21:09:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.716 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.716 21:09:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.716 21:09:47 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:53.716 21:09:47 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:53.716 21:09:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.716 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.716 21:09:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.716 21:09:47 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:53.716 21:09:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.716 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.716 21:09:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.716 21:09:47 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:53.716 21:09:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.717 21:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:53.717 [2024-04-23 21:09:47.855598] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:53.717 21:09:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.717 21:09:47 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:53.717 21:09:47 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:53.717 21:09:47 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:53.717 21:09:47 -- target/connect_disconnect.sh@34 -- # set +x 00:08:57.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.633 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.158 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.440 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.132 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.823 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.509 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.354 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.656 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.356 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.406 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.690 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.489 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.772 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.777 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.066 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.600 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.175 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.000 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.024 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.311 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.174 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.460 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.279 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:31.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.852 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:47.304 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.879 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:06.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.826 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:12.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:15.407 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:18.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.230 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:27.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:31.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:36.965 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:40.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:43.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:46.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:49.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:52.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:55.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:59.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:02.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:05.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:05.077 21:14:59 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:14:05.077 21:14:59 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:14:05.077 21:14:59 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:05.077 21:14:59 -- nvmf/common.sh@117 -- # sync 00:14:05.077 21:14:59 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:05.077 21:14:59 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:05.077 21:14:59 -- nvmf/common.sh@120 -- # set +e 00:14:05.077 21:14:59 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:05.077 21:14:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:05.077 rmmod nvme_rdma 00:14:05.077 rmmod nvme_fabrics 00:14:05.077 21:14:59 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:05.077 21:14:59 -- nvmf/common.sh@124 -- # set -e 00:14:05.077 21:14:59 -- nvmf/common.sh@125 -- # return 0 00:14:05.077 21:14:59 -- nvmf/common.sh@478 -- # '[' -n 1205620 ']' 00:14:05.077 21:14:59 -- nvmf/common.sh@479 -- # killprocess 1205620 00:14:05.077 21:14:59 -- common/autotest_common.sh@936 -- # '[' -z 1205620 ']' 00:14:05.077 21:14:59 -- common/autotest_common.sh@940 -- # kill -0 1205620 00:14:05.077 21:14:59 -- common/autotest_common.sh@941 -- # uname 00:14:05.077 21:14:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:05.077 21:14:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1205620 00:14:05.077 21:14:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:05.077 21:14:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:05.077 21:14:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1205620' 00:14:05.077 killing process with pid 1205620 00:14:05.077 21:14:59 -- common/autotest_common.sh@955 -- # kill 1205620 00:14:05.077 21:14:59 -- common/autotest_common.sh@960 -- # wait 1205620 00:14:05.336 [2024-04-23 21:14:59.390987] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:05.336 21:14:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:05.336 21:14:59 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:05.336 00:14:05.336 real 5m18.169s 00:14:05.336 user 20m46.121s 00:14:05.336 sys 0m13.750s 00:14:05.336 21:14:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:05.336 21:14:59 -- common/autotest_common.sh@10 -- # set +x 00:14:05.336 ************************************ 00:14:05.336 END TEST nvmf_connect_disconnect 00:14:05.336 ************************************ 00:14:05.595 21:14:59 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:14:05.595 21:14:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:05.595 21:14:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:05.595 21:14:59 -- common/autotest_common.sh@10 -- # set +x 00:14:05.595 ************************************ 00:14:05.595 START TEST nvmf_multitarget 00:14:05.595 ************************************ 00:14:05.595 21:14:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:14:05.595 * Looking for test storage... 00:14:05.855 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:05.855 21:14:59 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:05.855 21:14:59 -- nvmf/common.sh@7 -- # uname -s 00:14:05.855 21:14:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:05.855 21:14:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:05.855 21:14:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:05.855 21:14:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:05.855 21:14:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:05.855 21:14:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:05.855 21:14:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:05.855 21:14:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:05.855 21:14:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:05.855 21:14:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:05.855 21:14:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:05.855 21:14:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:05.855 21:14:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:05.855 21:14:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:05.855 21:14:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:05.855 21:14:59 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:05.855 21:14:59 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:05.855 21:14:59 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:05.855 21:14:59 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:05.855 21:14:59 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:05.855 21:14:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.855 21:14:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.855 21:14:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.855 21:14:59 -- paths/export.sh@5 -- # export PATH 00:14:05.855 21:14:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.855 21:14:59 -- nvmf/common.sh@47 -- # : 0 00:14:05.855 21:14:59 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:05.855 21:14:59 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:05.855 21:14:59 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:05.855 21:14:59 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:05.855 21:14:59 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:05.855 21:14:59 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:05.855 21:14:59 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:05.855 21:14:59 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:05.855 21:14:59 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:14:05.855 21:14:59 -- target/multitarget.sh@15 -- # nvmftestinit 00:14:05.855 21:14:59 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:05.855 21:14:59 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:05.855 21:14:59 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:05.855 21:14:59 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:05.855 21:14:59 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:05.855 21:14:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.855 21:14:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.855 21:14:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.855 21:14:59 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:05.855 21:14:59 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:05.855 21:14:59 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:05.855 21:14:59 -- common/autotest_common.sh@10 -- # set +x 00:14:11.131 21:15:05 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:11.131 21:15:05 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:11.131 21:15:05 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:11.131 21:15:05 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:11.131 21:15:05 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:11.131 21:15:05 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:11.131 21:15:05 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:11.131 21:15:05 -- nvmf/common.sh@295 -- # net_devs=() 00:14:11.131 21:15:05 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:11.131 21:15:05 -- nvmf/common.sh@296 -- # e810=() 00:14:11.131 21:15:05 -- nvmf/common.sh@296 -- # local -ga e810 00:14:11.131 21:15:05 -- nvmf/common.sh@297 -- # x722=() 00:14:11.131 21:15:05 -- nvmf/common.sh@297 -- # local -ga x722 00:14:11.131 21:15:05 -- nvmf/common.sh@298 -- # mlx=() 00:14:11.131 21:15:05 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:11.131 21:15:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:11.131 21:15:05 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:11.131 21:15:05 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:11.131 21:15:05 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:11.131 21:15:05 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:11.131 21:15:05 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:11.131 21:15:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:11.131 21:15:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:11.131 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:11.131 21:15:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:11.131 21:15:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:11.131 21:15:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:11.131 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:11.131 21:15:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:11.131 21:15:05 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:11.131 21:15:05 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:11.131 21:15:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:11.131 21:15:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.131 21:15:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:11.131 21:15:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.131 21:15:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:11.131 Found net devices under 0000:18:00.0: mlx_0_0 00:14:11.131 21:15:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.131 21:15:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:11.131 21:15:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:11.131 21:15:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:11.131 21:15:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:11.132 21:15:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:11.132 Found net devices under 0000:18:00.1: mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:11.132 21:15:05 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:11.132 21:15:05 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:11.132 21:15:05 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:11.132 21:15:05 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:11.132 21:15:05 -- nvmf/common.sh@58 -- # uname 00:14:11.132 21:15:05 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:11.132 21:15:05 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:11.132 21:15:05 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:11.132 21:15:05 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:11.132 21:15:05 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:11.132 21:15:05 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:11.132 21:15:05 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:11.132 21:15:05 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:11.132 21:15:05 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:11.132 21:15:05 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:11.132 21:15:05 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:11.132 21:15:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:11.132 21:15:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:11.132 21:15:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:11.132 21:15:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:11.132 21:15:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:11.132 21:15:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@105 -- # continue 2 00:14:11.132 21:15:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@105 -- # continue 2 00:14:11.132 21:15:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:11.132 21:15:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:11.132 21:15:05 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:11.132 21:15:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:11.132 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:11.132 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:14:11.132 altname enp24s0f0np0 00:14:11.132 altname ens785f0np0 00:14:11.132 inet 192.168.100.8/24 scope global mlx_0_0 00:14:11.132 valid_lft forever preferred_lft forever 00:14:11.132 21:15:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:11.132 21:15:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:11.132 21:15:05 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:11.132 21:15:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:11.132 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:11.132 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:14:11.132 altname enp24s0f1np1 00:14:11.132 altname ens785f1np1 00:14:11.132 inet 192.168.100.9/24 scope global mlx_0_1 00:14:11.132 valid_lft forever preferred_lft forever 00:14:11.132 21:15:05 -- nvmf/common.sh@411 -- # return 0 00:14:11.132 21:15:05 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:11.132 21:15:05 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:11.132 21:15:05 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:11.132 21:15:05 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:11.132 21:15:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:11.132 21:15:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:11.132 21:15:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:11.132 21:15:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:11.132 21:15:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:11.132 21:15:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@105 -- # continue 2 00:14:11.132 21:15:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:11.132 21:15:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:11.132 21:15:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@105 -- # continue 2 00:14:11.132 21:15:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:11.132 21:15:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:11.132 21:15:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:11.132 21:15:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:11.132 21:15:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:11.132 21:15:05 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:11.132 192.168.100.9' 00:14:11.132 21:15:05 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:11.132 192.168.100.9' 00:14:11.132 21:15:05 -- nvmf/common.sh@446 -- # head -n 1 00:14:11.132 21:15:05 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:11.132 21:15:05 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:11.132 192.168.100.9' 00:14:11.132 21:15:05 -- nvmf/common.sh@447 -- # tail -n +2 00:14:11.132 21:15:05 -- nvmf/common.sh@447 -- # head -n 1 00:14:11.132 21:15:05 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:11.132 21:15:05 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:11.132 21:15:05 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:11.132 21:15:05 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:11.132 21:15:05 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:11.132 21:15:05 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:11.132 21:15:05 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:14:11.132 21:15:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:11.132 21:15:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:11.132 21:15:05 -- common/autotest_common.sh@10 -- # set +x 00:14:11.132 21:15:05 -- nvmf/common.sh@470 -- # nvmfpid=1268238 00:14:11.132 21:15:05 -- nvmf/common.sh@471 -- # waitforlisten 1268238 00:14:11.132 21:15:05 -- common/autotest_common.sh@817 -- # '[' -z 1268238 ']' 00:14:11.132 21:15:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:11.132 21:15:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:11.132 21:15:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:11.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:11.132 21:15:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:11.132 21:15:05 -- common/autotest_common.sh@10 -- # set +x 00:14:11.132 21:15:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:11.132 [2024-04-23 21:15:05.296641] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:14:11.132 [2024-04-23 21:15:05.296686] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:11.132 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.132 [2024-04-23 21:15:05.347825] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:11.391 [2024-04-23 21:15:05.421933] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:11.391 [2024-04-23 21:15:05.421963] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:11.391 [2024-04-23 21:15:05.421972] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:11.391 [2024-04-23 21:15:05.421978] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:11.391 [2024-04-23 21:15:05.421984] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:11.391 [2024-04-23 21:15:05.422031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:11.391 [2024-04-23 21:15:05.422068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:11.391 [2024-04-23 21:15:05.422071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.391 [2024-04-23 21:15:05.422048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:11.958 21:15:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:11.958 21:15:06 -- common/autotest_common.sh@850 -- # return 0 00:14:11.958 21:15:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:11.958 21:15:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:11.958 21:15:06 -- common/autotest_common.sh@10 -- # set +x 00:14:11.958 21:15:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.958 21:15:06 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:11.958 21:15:06 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:11.958 21:15:06 -- target/multitarget.sh@21 -- # jq length 00:14:11.958 21:15:06 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:14:11.958 21:15:06 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:14:12.216 "nvmf_tgt_1" 00:14:12.216 21:15:06 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:14:12.216 "nvmf_tgt_2" 00:14:12.216 21:15:06 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:12.216 21:15:06 -- target/multitarget.sh@28 -- # jq length 00:14:12.474 21:15:06 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:14:12.474 21:15:06 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:14:12.474 true 00:14:12.474 21:15:06 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:14:12.474 true 00:14:12.474 21:15:06 -- target/multitarget.sh@35 -- # jq length 00:14:12.474 21:15:06 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:12.734 21:15:06 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:14:12.734 21:15:06 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:14:12.734 21:15:06 -- target/multitarget.sh@41 -- # nvmftestfini 00:14:12.734 21:15:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:12.734 21:15:06 -- nvmf/common.sh@117 -- # sync 00:14:12.734 21:15:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:12.734 21:15:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:12.734 21:15:06 -- nvmf/common.sh@120 -- # set +e 00:14:12.734 21:15:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:12.734 21:15:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:12.734 rmmod nvme_rdma 00:14:12.734 rmmod nvme_fabrics 00:14:12.734 21:15:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:12.734 21:15:06 -- nvmf/common.sh@124 -- # set -e 00:14:12.734 21:15:06 -- nvmf/common.sh@125 -- # return 0 00:14:12.734 21:15:06 -- nvmf/common.sh@478 -- # '[' -n 1268238 ']' 00:14:12.734 21:15:06 -- nvmf/common.sh@479 -- # killprocess 1268238 00:14:12.734 21:15:06 -- common/autotest_common.sh@936 -- # '[' -z 1268238 ']' 00:14:12.734 21:15:06 -- common/autotest_common.sh@940 -- # kill -0 1268238 00:14:12.734 21:15:06 -- common/autotest_common.sh@941 -- # uname 00:14:12.734 21:15:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:12.734 21:15:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1268238 00:14:12.734 21:15:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:12.734 21:15:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:12.734 21:15:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1268238' 00:14:12.734 killing process with pid 1268238 00:14:12.734 21:15:06 -- common/autotest_common.sh@955 -- # kill 1268238 00:14:12.734 21:15:06 -- common/autotest_common.sh@960 -- # wait 1268238 00:14:12.993 21:15:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:12.993 21:15:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:12.993 00:14:12.993 real 0m7.294s 00:14:12.993 user 0m8.663s 00:14:12.993 sys 0m4.535s 00:14:12.993 21:15:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:12.993 21:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:12.993 ************************************ 00:14:12.993 END TEST nvmf_multitarget 00:14:12.993 ************************************ 00:14:12.993 21:15:07 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:14:12.993 21:15:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:12.993 21:15:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.993 21:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:12.993 ************************************ 00:14:12.993 START TEST nvmf_rpc 00:14:12.993 ************************************ 00:14:12.993 21:15:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:14:13.254 * Looking for test storage... 00:14:13.254 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:13.254 21:15:07 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:13.254 21:15:07 -- nvmf/common.sh@7 -- # uname -s 00:14:13.254 21:15:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:13.254 21:15:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:13.254 21:15:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:13.254 21:15:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:13.254 21:15:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:13.254 21:15:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:13.254 21:15:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:13.254 21:15:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:13.254 21:15:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:13.254 21:15:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:13.254 21:15:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:13.254 21:15:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:13.254 21:15:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:13.254 21:15:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:13.254 21:15:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:13.254 21:15:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:13.254 21:15:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:13.254 21:15:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:13.254 21:15:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:13.254 21:15:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:13.254 21:15:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.254 21:15:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.254 21:15:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.254 21:15:07 -- paths/export.sh@5 -- # export PATH 00:14:13.254 21:15:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:13.254 21:15:07 -- nvmf/common.sh@47 -- # : 0 00:14:13.254 21:15:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:13.254 21:15:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:13.254 21:15:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:13.254 21:15:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:13.254 21:15:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:13.254 21:15:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:13.254 21:15:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:13.254 21:15:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:13.254 21:15:07 -- target/rpc.sh@11 -- # loops=5 00:14:13.254 21:15:07 -- target/rpc.sh@23 -- # nvmftestinit 00:14:13.254 21:15:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:13.254 21:15:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:13.254 21:15:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:13.254 21:15:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:13.254 21:15:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:13.254 21:15:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:13.254 21:15:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:13.254 21:15:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:13.254 21:15:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:13.254 21:15:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:13.254 21:15:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:13.254 21:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:18.531 21:15:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:18.531 21:15:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:18.531 21:15:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:18.531 21:15:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:18.531 21:15:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:18.531 21:15:12 -- nvmf/common.sh@295 -- # net_devs=() 00:14:18.531 21:15:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@296 -- # e810=() 00:14:18.531 21:15:12 -- nvmf/common.sh@296 -- # local -ga e810 00:14:18.531 21:15:12 -- nvmf/common.sh@297 -- # x722=() 00:14:18.531 21:15:12 -- nvmf/common.sh@297 -- # local -ga x722 00:14:18.531 21:15:12 -- nvmf/common.sh@298 -- # mlx=() 00:14:18.531 21:15:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:18.531 21:15:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:18.531 21:15:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:18.531 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:18.531 21:15:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:18.531 21:15:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:18.531 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:18.531 21:15:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:18.531 21:15:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:18.531 21:15:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:18.531 21:15:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:18.531 Found net devices under 0000:18:00.0: mlx_0_0 00:14:18.531 21:15:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:18.531 21:15:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:18.531 21:15:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:18.531 Found net devices under 0000:18:00.1: mlx_0_1 00:14:18.531 21:15:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:18.531 21:15:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:18.531 21:15:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:18.531 21:15:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:18.531 21:15:12 -- nvmf/common.sh@58 -- # uname 00:14:18.531 21:15:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:18.531 21:15:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:18.531 21:15:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:18.531 21:15:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:18.531 21:15:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:18.531 21:15:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:18.531 21:15:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:18.531 21:15:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:18.531 21:15:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:18.531 21:15:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:18.531 21:15:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:18.531 21:15:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:18.531 21:15:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:18.531 21:15:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:18.531 21:15:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:18.531 21:15:12 -- nvmf/common.sh@105 -- # continue 2 00:14:18.531 21:15:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.531 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:18.531 21:15:12 -- nvmf/common.sh@105 -- # continue 2 00:14:18.531 21:15:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:18.531 21:15:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:18.531 21:15:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:18.531 21:15:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:18.531 21:15:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:18.531 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:18.531 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:14:18.531 altname enp24s0f0np0 00:14:18.531 altname ens785f0np0 00:14:18.531 inet 192.168.100.8/24 scope global mlx_0_0 00:14:18.531 valid_lft forever preferred_lft forever 00:14:18.531 21:15:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:18.531 21:15:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:18.531 21:15:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:18.531 21:15:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:18.531 21:15:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:18.531 21:15:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:18.531 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:18.531 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:14:18.531 altname enp24s0f1np1 00:14:18.531 altname ens785f1np1 00:14:18.531 inet 192.168.100.9/24 scope global mlx_0_1 00:14:18.531 valid_lft forever preferred_lft forever 00:14:18.531 21:15:12 -- nvmf/common.sh@411 -- # return 0 00:14:18.531 21:15:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:18.531 21:15:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:18.531 21:15:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:18.531 21:15:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:18.531 21:15:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:18.531 21:15:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:18.531 21:15:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:18.531 21:15:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:18.795 21:15:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:18.796 21:15:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:18.796 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.796 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:18.796 21:15:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:18.796 21:15:12 -- nvmf/common.sh@105 -- # continue 2 00:14:18.796 21:15:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:18.796 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.796 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:18.796 21:15:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:18.796 21:15:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:18.796 21:15:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:18.796 21:15:12 -- nvmf/common.sh@105 -- # continue 2 00:14:18.796 21:15:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:18.796 21:15:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:18.796 21:15:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:18.796 21:15:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:18.796 21:15:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:18.796 21:15:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:18.796 21:15:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:18.796 21:15:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:18.796 192.168.100.9' 00:14:18.796 21:15:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:18.796 192.168.100.9' 00:14:18.796 21:15:12 -- nvmf/common.sh@446 -- # head -n 1 00:14:18.796 21:15:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:18.796 21:15:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:18.796 192.168.100.9' 00:14:18.796 21:15:12 -- nvmf/common.sh@447 -- # tail -n +2 00:14:18.796 21:15:12 -- nvmf/common.sh@447 -- # head -n 1 00:14:18.796 21:15:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:18.796 21:15:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:18.796 21:15:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:18.796 21:15:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:18.796 21:15:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:18.796 21:15:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:18.796 21:15:12 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:14:18.796 21:15:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:18.796 21:15:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:18.796 21:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:18.796 21:15:12 -- nvmf/common.sh@470 -- # nvmfpid=1272165 00:14:18.796 21:15:12 -- nvmf/common.sh@471 -- # waitforlisten 1272165 00:14:18.796 21:15:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:18.796 21:15:12 -- common/autotest_common.sh@817 -- # '[' -z 1272165 ']' 00:14:18.796 21:15:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:18.796 21:15:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:18.796 21:15:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:18.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:18.796 21:15:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:18.796 21:15:12 -- common/autotest_common.sh@10 -- # set +x 00:14:18.796 [2024-04-23 21:15:12.932958] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:14:18.796 [2024-04-23 21:15:12.933001] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:18.796 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.796 [2024-04-23 21:15:12.984503] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:18.796 [2024-04-23 21:15:13.048793] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:18.796 [2024-04-23 21:15:13.048835] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:18.796 [2024-04-23 21:15:13.048842] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:18.796 [2024-04-23 21:15:13.048849] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:18.796 [2024-04-23 21:15:13.048854] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:18.796 [2024-04-23 21:15:13.048905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:18.796 [2024-04-23 21:15:13.049016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:18.796 [2024-04-23 21:15:13.049097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:18.796 [2024-04-23 21:15:13.049100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:19.733 21:15:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:19.733 21:15:13 -- common/autotest_common.sh@850 -- # return 0 00:14:19.733 21:15:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:19.733 21:15:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:19.733 21:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:19.733 21:15:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:19.733 21:15:13 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:14:19.733 21:15:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.733 21:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:19.733 21:15:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.733 21:15:13 -- target/rpc.sh@26 -- # stats='{ 00:14:19.733 "tick_rate": 2700000000, 00:14:19.733 "poll_groups": [ 00:14:19.733 { 00:14:19.733 "name": "nvmf_tgt_poll_group_0", 00:14:19.733 "admin_qpairs": 0, 00:14:19.733 "io_qpairs": 0, 00:14:19.733 "current_admin_qpairs": 0, 00:14:19.733 "current_io_qpairs": 0, 00:14:19.733 "pending_bdev_io": 0, 00:14:19.733 "completed_nvme_io": 0, 00:14:19.733 "transports": [] 00:14:19.733 }, 00:14:19.733 { 00:14:19.733 "name": "nvmf_tgt_poll_group_1", 00:14:19.733 "admin_qpairs": 0, 00:14:19.733 "io_qpairs": 0, 00:14:19.733 "current_admin_qpairs": 0, 00:14:19.733 "current_io_qpairs": 0, 00:14:19.733 "pending_bdev_io": 0, 00:14:19.733 "completed_nvme_io": 0, 00:14:19.733 "transports": [] 00:14:19.733 }, 00:14:19.733 { 00:14:19.733 "name": "nvmf_tgt_poll_group_2", 00:14:19.733 "admin_qpairs": 0, 00:14:19.733 "io_qpairs": 0, 00:14:19.733 "current_admin_qpairs": 0, 00:14:19.733 "current_io_qpairs": 0, 00:14:19.733 "pending_bdev_io": 0, 00:14:19.733 "completed_nvme_io": 0, 00:14:19.733 "transports": [] 00:14:19.733 }, 00:14:19.733 { 00:14:19.733 "name": "nvmf_tgt_poll_group_3", 00:14:19.733 "admin_qpairs": 0, 00:14:19.733 "io_qpairs": 0, 00:14:19.733 "current_admin_qpairs": 0, 00:14:19.733 "current_io_qpairs": 0, 00:14:19.733 "pending_bdev_io": 0, 00:14:19.733 "completed_nvme_io": 0, 00:14:19.733 "transports": [] 00:14:19.733 } 00:14:19.733 ] 00:14:19.733 }' 00:14:19.733 21:15:13 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:14:19.733 21:15:13 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:14:19.733 21:15:13 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:14:19.733 21:15:13 -- target/rpc.sh@15 -- # wc -l 00:14:19.733 21:15:13 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:14:19.733 21:15:13 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:14:19.733 21:15:13 -- target/rpc.sh@29 -- # [[ null == null ]] 00:14:19.733 21:15:13 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:19.733 21:15:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.733 21:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:19.733 [2024-04-23 21:15:13.875953] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x5d26e0/0x5d6bd0) succeed. 00:14:19.733 [2024-04-23 21:15:13.885108] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x5d3d20/0x618260) succeed. 00:14:19.733 21:15:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.733 21:15:13 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:14:19.733 21:15:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.733 21:15:13 -- common/autotest_common.sh@10 -- # set +x 00:14:19.992 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.992 21:15:14 -- target/rpc.sh@33 -- # stats='{ 00:14:19.992 "tick_rate": 2700000000, 00:14:19.992 "poll_groups": [ 00:14:19.992 { 00:14:19.992 "name": "nvmf_tgt_poll_group_0", 00:14:19.992 "admin_qpairs": 0, 00:14:19.992 "io_qpairs": 0, 00:14:19.992 "current_admin_qpairs": 0, 00:14:19.992 "current_io_qpairs": 0, 00:14:19.992 "pending_bdev_io": 0, 00:14:19.992 "completed_nvme_io": 0, 00:14:19.992 "transports": [ 00:14:19.992 { 00:14:19.992 "trtype": "RDMA", 00:14:19.992 "pending_data_buffer": 0, 00:14:19.992 "devices": [ 00:14:19.992 { 00:14:19.992 "name": "mlx5_0", 00:14:19.992 "polls": 14739, 00:14:19.992 "idle_polls": 14739, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.992 "send_doorbell_updates": 0, 00:14:19.992 "total_recv_wrs": 4096, 00:14:19.992 "recv_doorbell_updates": 1 00:14:19.992 }, 00:14:19.992 { 00:14:19.992 "name": "mlx5_1", 00:14:19.992 "polls": 14739, 00:14:19.992 "idle_polls": 14739, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.992 "send_doorbell_updates": 0, 00:14:19.992 "total_recv_wrs": 4096, 00:14:19.992 "recv_doorbell_updates": 1 00:14:19.992 } 00:14:19.992 ] 00:14:19.992 } 00:14:19.992 ] 00:14:19.992 }, 00:14:19.992 { 00:14:19.992 "name": "nvmf_tgt_poll_group_1", 00:14:19.992 "admin_qpairs": 0, 00:14:19.992 "io_qpairs": 0, 00:14:19.992 "current_admin_qpairs": 0, 00:14:19.992 "current_io_qpairs": 0, 00:14:19.992 "pending_bdev_io": 0, 00:14:19.992 "completed_nvme_io": 0, 00:14:19.992 "transports": [ 00:14:19.992 { 00:14:19.992 "trtype": "RDMA", 00:14:19.992 "pending_data_buffer": 0, 00:14:19.992 "devices": [ 00:14:19.992 { 00:14:19.992 "name": "mlx5_0", 00:14:19.992 "polls": 9260, 00:14:19.992 "idle_polls": 9260, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.992 "send_doorbell_updates": 0, 00:14:19.992 "total_recv_wrs": 4096, 00:14:19.992 "recv_doorbell_updates": 1 00:14:19.992 }, 00:14:19.992 { 00:14:19.992 "name": "mlx5_1", 00:14:19.992 "polls": 9260, 00:14:19.992 "idle_polls": 9260, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.992 "send_doorbell_updates": 0, 00:14:19.992 "total_recv_wrs": 4096, 00:14:19.992 "recv_doorbell_updates": 1 00:14:19.992 } 00:14:19.992 ] 00:14:19.992 } 00:14:19.992 ] 00:14:19.992 }, 00:14:19.992 { 00:14:19.992 "name": "nvmf_tgt_poll_group_2", 00:14:19.992 "admin_qpairs": 0, 00:14:19.992 "io_qpairs": 0, 00:14:19.992 "current_admin_qpairs": 0, 00:14:19.992 "current_io_qpairs": 0, 00:14:19.992 "pending_bdev_io": 0, 00:14:19.992 "completed_nvme_io": 0, 00:14:19.992 "transports": [ 00:14:19.992 { 00:14:19.992 "trtype": "RDMA", 00:14:19.992 "pending_data_buffer": 0, 00:14:19.992 "devices": [ 00:14:19.992 { 00:14:19.992 "name": "mlx5_0", 00:14:19.992 "polls": 5261, 00:14:19.992 "idle_polls": 5261, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.992 "send_doorbell_updates": 0, 00:14:19.992 "total_recv_wrs": 4096, 00:14:19.992 "recv_doorbell_updates": 1 00:14:19.992 }, 00:14:19.992 { 00:14:19.992 "name": "mlx5_1", 00:14:19.992 "polls": 5261, 00:14:19.992 "idle_polls": 5261, 00:14:19.992 "completions": 0, 00:14:19.992 "requests": 0, 00:14:19.992 "request_latency": 0, 00:14:19.992 "pending_free_request": 0, 00:14:19.992 "pending_rdma_read": 0, 00:14:19.992 "pending_rdma_write": 0, 00:14:19.992 "pending_rdma_send": 0, 00:14:19.992 "total_send_wrs": 0, 00:14:19.993 "send_doorbell_updates": 0, 00:14:19.993 "total_recv_wrs": 4096, 00:14:19.993 "recv_doorbell_updates": 1 00:14:19.993 } 00:14:19.993 ] 00:14:19.993 } 00:14:19.993 ] 00:14:19.993 }, 00:14:19.993 { 00:14:19.993 "name": "nvmf_tgt_poll_group_3", 00:14:19.993 "admin_qpairs": 0, 00:14:19.993 "io_qpairs": 0, 00:14:19.993 "current_admin_qpairs": 0, 00:14:19.993 "current_io_qpairs": 0, 00:14:19.993 "pending_bdev_io": 0, 00:14:19.993 "completed_nvme_io": 0, 00:14:19.993 "transports": [ 00:14:19.993 { 00:14:19.993 "trtype": "RDMA", 00:14:19.993 "pending_data_buffer": 0, 00:14:19.993 "devices": [ 00:14:19.993 { 00:14:19.993 "name": "mlx5_0", 00:14:19.993 "polls": 916, 00:14:19.993 "idle_polls": 916, 00:14:19.993 "completions": 0, 00:14:19.993 "requests": 0, 00:14:19.993 "request_latency": 0, 00:14:19.993 "pending_free_request": 0, 00:14:19.993 "pending_rdma_read": 0, 00:14:19.993 "pending_rdma_write": 0, 00:14:19.993 "pending_rdma_send": 0, 00:14:19.993 "total_send_wrs": 0, 00:14:19.993 "send_doorbell_updates": 0, 00:14:19.993 "total_recv_wrs": 4096, 00:14:19.993 "recv_doorbell_updates": 1 00:14:19.993 }, 00:14:19.993 { 00:14:19.993 "name": "mlx5_1", 00:14:19.993 "polls": 916, 00:14:19.993 "idle_polls": 916, 00:14:19.993 "completions": 0, 00:14:19.993 "requests": 0, 00:14:19.993 "request_latency": 0, 00:14:19.993 "pending_free_request": 0, 00:14:19.993 "pending_rdma_read": 0, 00:14:19.993 "pending_rdma_write": 0, 00:14:19.993 "pending_rdma_send": 0, 00:14:19.993 "total_send_wrs": 0, 00:14:19.993 "send_doorbell_updates": 0, 00:14:19.993 "total_recv_wrs": 4096, 00:14:19.993 "recv_doorbell_updates": 1 00:14:19.993 } 00:14:19.993 ] 00:14:19.993 } 00:14:19.993 ] 00:14:19.993 } 00:14:19.993 ] 00:14:19.993 }' 00:14:19.993 21:15:14 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:19.993 21:15:14 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:14:19.993 21:15:14 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:19.993 21:15:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:19.993 21:15:14 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:14:19.993 21:15:14 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:14:19.993 21:15:14 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:14:19.993 21:15:14 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:14:19.993 21:15:14 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:14:19.993 21:15:14 -- target/rpc.sh@15 -- # wc -l 00:14:19.993 21:15:14 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:14:19.993 21:15:14 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:14:19.993 21:15:14 -- target/rpc.sh@41 -- # transport_type=RDMA 00:14:19.993 21:15:14 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:14:19.993 21:15:14 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:14:19.993 21:15:14 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:14:19.993 21:15:14 -- target/rpc.sh@15 -- # wc -l 00:14:19.993 21:15:14 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:14:19.993 21:15:14 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:14:19.993 21:15:14 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:14:19.993 21:15:14 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:14:19.993 21:15:14 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:19.993 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.993 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:19.993 Malloc1 00:14:19.993 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.993 21:15:14 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:19.993 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.993 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:20.252 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.252 21:15:14 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:20.252 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.252 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:20.252 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.252 21:15:14 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:14:20.252 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.252 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:20.252 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.252 21:15:14 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:20.252 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.252 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:20.252 [2024-04-23 21:15:14.288761] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:20.252 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.252 21:15:14 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:20.252 21:15:14 -- common/autotest_common.sh@638 -- # local es=0 00:14:20.252 21:15:14 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:20.252 21:15:14 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:20.252 21:15:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:20.252 21:15:14 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:20.252 21:15:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:20.252 21:15:14 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:20.252 21:15:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:20.252 21:15:14 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:20.252 21:15:14 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:20.252 21:15:14 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:20.252 [2024-04-23 21:15:14.327649] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562' 00:14:20.252 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:20.252 could not add new controller: failed to write to nvme-fabrics device 00:14:20.252 21:15:14 -- common/autotest_common.sh@641 -- # es=1 00:14:20.252 21:15:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:20.252 21:15:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:20.252 21:15:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:20.252 21:15:14 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:20.252 21:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:20.252 21:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:20.252 21:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:20.252 21:15:14 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:21.189 21:15:15 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:14:21.189 21:15:15 -- common/autotest_common.sh@1184 -- # local i=0 00:14:21.189 21:15:15 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:21.189 21:15:15 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:21.189 21:15:15 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:23.093 21:15:17 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:23.093 21:15:17 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:23.093 21:15:17 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:23.093 21:15:17 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:23.093 21:15:17 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:23.093 21:15:17 -- common/autotest_common.sh@1194 -- # return 0 00:14:23.093 21:15:17 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:24.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:24.029 21:15:18 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:24.029 21:15:18 -- common/autotest_common.sh@1205 -- # local i=0 00:14:24.029 21:15:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:24.029 21:15:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:24.288 21:15:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:24.288 21:15:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:24.288 21:15:18 -- common/autotest_common.sh@1217 -- # return 0 00:14:24.288 21:15:18 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:24.288 21:15:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:24.288 21:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:24.288 21:15:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:24.288 21:15:18 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:24.288 21:15:18 -- common/autotest_common.sh@638 -- # local es=0 00:14:24.288 21:15:18 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:24.288 21:15:18 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:24.288 21:15:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:24.288 21:15:18 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:24.288 21:15:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:24.288 21:15:18 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:24.288 21:15:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:24.288 21:15:18 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:24.288 21:15:18 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:24.288 21:15:18 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:24.288 [2024-04-23 21:15:18.369268] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562' 00:14:24.288 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:24.288 could not add new controller: failed to write to nvme-fabrics device 00:14:24.288 21:15:18 -- common/autotest_common.sh@641 -- # es=1 00:14:24.288 21:15:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:24.288 21:15:18 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:24.288 21:15:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:24.288 21:15:18 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:14:24.288 21:15:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:24.288 21:15:18 -- common/autotest_common.sh@10 -- # set +x 00:14:24.288 21:15:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:24.288 21:15:18 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:25.223 21:15:19 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:14:25.223 21:15:19 -- common/autotest_common.sh@1184 -- # local i=0 00:14:25.223 21:15:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:25.223 21:15:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:25.223 21:15:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:27.127 21:15:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:27.127 21:15:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:27.127 21:15:21 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:27.386 21:15:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:27.386 21:15:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:27.386 21:15:21 -- common/autotest_common.sh@1194 -- # return 0 00:14:27.386 21:15:21 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:28.322 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:28.322 21:15:22 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:28.322 21:15:22 -- common/autotest_common.sh@1205 -- # local i=0 00:14:28.322 21:15:22 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:28.322 21:15:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:28.322 21:15:22 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:28.322 21:15:22 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:28.322 21:15:22 -- common/autotest_common.sh@1217 -- # return 0 00:14:28.322 21:15:22 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:28.322 21:15:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.322 21:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:28.322 21:15:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.322 21:15:22 -- target/rpc.sh@81 -- # seq 1 5 00:14:28.322 21:15:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:28.322 21:15:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:28.322 21:15:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.322 21:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:28.322 21:15:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.322 21:15:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:28.322 21:15:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.322 21:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:28.322 [2024-04-23 21:15:22.393043] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:28.322 21:15:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.322 21:15:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:28.322 21:15:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.322 21:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:28.322 21:15:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.322 21:15:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:28.322 21:15:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:28.322 21:15:22 -- common/autotest_common.sh@10 -- # set +x 00:14:28.322 21:15:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:28.322 21:15:22 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:29.256 21:15:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:29.256 21:15:23 -- common/autotest_common.sh@1184 -- # local i=0 00:14:29.256 21:15:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:29.256 21:15:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:29.256 21:15:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:31.160 21:15:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:31.160 21:15:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:31.160 21:15:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:31.160 21:15:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:31.160 21:15:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:31.160 21:15:25 -- common/autotest_common.sh@1194 -- # return 0 00:14:31.160 21:15:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:32.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:32.097 21:15:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:32.097 21:15:26 -- common/autotest_common.sh@1205 -- # local i=0 00:14:32.097 21:15:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:32.097 21:15:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:32.097 21:15:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:32.097 21:15:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:32.097 21:15:26 -- common/autotest_common.sh@1217 -- # return 0 00:14:32.097 21:15:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.097 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.097 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.097 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.097 21:15:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:32.097 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.097 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.097 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.097 21:15:26 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:32.097 21:15:26 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:32.097 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.097 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.097 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.097 21:15:26 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:32.097 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.097 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.356 [2024-04-23 21:15:26.369975] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:32.356 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.356 21:15:26 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:32.356 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.356 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.356 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.356 21:15:26 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:32.356 21:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:32.356 21:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:32.356 21:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:32.356 21:15:26 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:33.292 21:15:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:33.292 21:15:27 -- common/autotest_common.sh@1184 -- # local i=0 00:14:33.292 21:15:27 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:33.292 21:15:27 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:33.292 21:15:27 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:35.198 21:15:29 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:35.198 21:15:29 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:35.198 21:15:29 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:35.198 21:15:29 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:35.198 21:15:29 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:35.198 21:15:29 -- common/autotest_common.sh@1194 -- # return 0 00:14:35.198 21:15:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:36.166 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:36.166 21:15:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:36.166 21:15:30 -- common/autotest_common.sh@1205 -- # local i=0 00:14:36.166 21:15:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:36.166 21:15:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:36.166 21:15:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:36.166 21:15:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:36.166 21:15:30 -- common/autotest_common.sh@1217 -- # return 0 00:14:36.166 21:15:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:36.166 21:15:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 [2024-04-23 21:15:30.374241] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:36.166 21:15:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:36.166 21:15:30 -- common/autotest_common.sh@10 -- # set +x 00:14:36.166 21:15:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:36.166 21:15:30 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:37.101 21:15:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:37.101 21:15:31 -- common/autotest_common.sh@1184 -- # local i=0 00:14:37.101 21:15:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:37.101 21:15:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:37.101 21:15:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:39.635 21:15:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:39.635 21:15:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:39.635 21:15:33 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:39.635 21:15:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:39.635 21:15:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:39.635 21:15:33 -- common/autotest_common.sh@1194 -- # return 0 00:14:39.635 21:15:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:40.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:40.201 21:15:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:40.201 21:15:34 -- common/autotest_common.sh@1205 -- # local i=0 00:14:40.201 21:15:34 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:40.201 21:15:34 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:40.202 21:15:34 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:40.202 21:15:34 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:40.202 21:15:34 -- common/autotest_common.sh@1217 -- # return 0 00:14:40.202 21:15:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:40.202 21:15:34 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 [2024-04-23 21:15:34.344339] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:40.202 21:15:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:40.202 21:15:34 -- common/autotest_common.sh@10 -- # set +x 00:14:40.202 21:15:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:40.202 21:15:34 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:41.137 21:15:35 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:41.137 21:15:35 -- common/autotest_common.sh@1184 -- # local i=0 00:14:41.137 21:15:35 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:41.137 21:15:35 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:41.137 21:15:35 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:43.667 21:15:37 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:43.667 21:15:37 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:43.667 21:15:37 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:43.667 21:15:37 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:43.667 21:15:37 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:43.667 21:15:37 -- common/autotest_common.sh@1194 -- # return 0 00:14:43.667 21:15:37 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:44.233 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:44.233 21:15:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:44.233 21:15:38 -- common/autotest_common.sh@1205 -- # local i=0 00:14:44.233 21:15:38 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:44.233 21:15:38 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:44.233 21:15:38 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:44.233 21:15:38 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:44.233 21:15:38 -- common/autotest_common.sh@1217 -- # return 0 00:14:44.233 21:15:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:44.233 21:15:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 [2024-04-23 21:15:38.329893] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:44.233 21:15:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.233 21:15:38 -- common/autotest_common.sh@10 -- # set +x 00:14:44.233 21:15:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.233 21:15:38 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:45.167 21:15:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:45.167 21:15:39 -- common/autotest_common.sh@1184 -- # local i=0 00:14:45.167 21:15:39 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:45.167 21:15:39 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:45.167 21:15:39 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:47.067 21:15:41 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:47.067 21:15:41 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:47.067 21:15:41 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:47.067 21:15:41 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:47.067 21:15:41 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:47.067 21:15:41 -- common/autotest_common.sh@1194 -- # return 0 00:14:47.067 21:15:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:48.443 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:48.443 21:15:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:48.443 21:15:42 -- common/autotest_common.sh@1205 -- # local i=0 00:14:48.443 21:15:42 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:48.443 21:15:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:48.443 21:15:42 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:48.443 21:15:42 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:48.443 21:15:42 -- common/autotest_common.sh@1217 -- # return 0 00:14:48.443 21:15:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:48.443 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.443 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.443 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.443 21:15:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.443 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.443 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.443 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.443 21:15:42 -- target/rpc.sh@99 -- # seq 1 5 00:14:48.443 21:15:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:48.443 21:15:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:48.443 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.443 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.443 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.443 21:15:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:48.443 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.443 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.443 [2024-04-23 21:15:42.345836] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:48.444 21:15:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 [2024-04-23 21:15:42.393995] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:48.444 21:15:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 [2024-04-23 21:15:42.442159] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:48.444 21:15:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 [2024-04-23 21:15:42.494345] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:48.444 21:15:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 [2024-04-23 21:15:42.542514] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:14:48.444 21:15:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:48.444 21:15:42 -- common/autotest_common.sh@10 -- # set +x 00:14:48.444 21:15:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:48.444 21:15:42 -- target/rpc.sh@110 -- # stats='{ 00:14:48.444 "tick_rate": 2700000000, 00:14:48.444 "poll_groups": [ 00:14:48.444 { 00:14:48.444 "name": "nvmf_tgt_poll_group_0", 00:14:48.444 "admin_qpairs": 2, 00:14:48.444 "io_qpairs": 27, 00:14:48.444 "current_admin_qpairs": 0, 00:14:48.444 "current_io_qpairs": 0, 00:14:48.444 "pending_bdev_io": 0, 00:14:48.444 "completed_nvme_io": 225, 00:14:48.444 "transports": [ 00:14:48.444 { 00:14:48.444 "trtype": "RDMA", 00:14:48.444 "pending_data_buffer": 0, 00:14:48.444 "devices": [ 00:14:48.444 { 00:14:48.444 "name": "mlx5_0", 00:14:48.444 "polls": 3546842, 00:14:48.444 "idle_polls": 3546359, 00:14:48.444 "completions": 565, 00:14:48.444 "requests": 282, 00:14:48.444 "request_latency": 65665942, 00:14:48.444 "pending_free_request": 0, 00:14:48.444 "pending_rdma_read": 0, 00:14:48.444 "pending_rdma_write": 0, 00:14:48.444 "pending_rdma_send": 0, 00:14:48.444 "total_send_wrs": 507, 00:14:48.444 "send_doorbell_updates": 235, 00:14:48.444 "total_recv_wrs": 4378, 00:14:48.444 "recv_doorbell_updates": 235 00:14:48.444 }, 00:14:48.444 { 00:14:48.444 "name": "mlx5_1", 00:14:48.444 "polls": 3546842, 00:14:48.444 "idle_polls": 3546842, 00:14:48.445 "completions": 0, 00:14:48.445 "requests": 0, 00:14:48.445 "request_latency": 0, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 0, 00:14:48.445 "send_doorbell_updates": 0, 00:14:48.445 "total_recv_wrs": 4096, 00:14:48.445 "recv_doorbell_updates": 1 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "nvmf_tgt_poll_group_1", 00:14:48.445 "admin_qpairs": 2, 00:14:48.445 "io_qpairs": 26, 00:14:48.445 "current_admin_qpairs": 0, 00:14:48.445 "current_io_qpairs": 0, 00:14:48.445 "pending_bdev_io": 0, 00:14:48.445 "completed_nvme_io": 27, 00:14:48.445 "transports": [ 00:14:48.445 { 00:14:48.445 "trtype": "RDMA", 00:14:48.445 "pending_data_buffer": 0, 00:14:48.445 "devices": [ 00:14:48.445 { 00:14:48.445 "name": "mlx5_0", 00:14:48.445 "polls": 3608678, 00:14:48.445 "idle_polls": 3608514, 00:14:48.445 "completions": 164, 00:14:48.445 "requests": 82, 00:14:48.445 "request_latency": 8205660, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 108, 00:14:48.445 "send_doorbell_updates": 82, 00:14:48.445 "total_recv_wrs": 4178, 00:14:48.445 "recv_doorbell_updates": 83 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "mlx5_1", 00:14:48.445 "polls": 3608678, 00:14:48.445 "idle_polls": 3608678, 00:14:48.445 "completions": 0, 00:14:48.445 "requests": 0, 00:14:48.445 "request_latency": 0, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 0, 00:14:48.445 "send_doorbell_updates": 0, 00:14:48.445 "total_recv_wrs": 4096, 00:14:48.445 "recv_doorbell_updates": 1 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "nvmf_tgt_poll_group_2", 00:14:48.445 "admin_qpairs": 1, 00:14:48.445 "io_qpairs": 26, 00:14:48.445 "current_admin_qpairs": 0, 00:14:48.445 "current_io_qpairs": 0, 00:14:48.445 "pending_bdev_io": 0, 00:14:48.445 "completed_nvme_io": 77, 00:14:48.445 "transports": [ 00:14:48.445 { 00:14:48.445 "trtype": "RDMA", 00:14:48.445 "pending_data_buffer": 0, 00:14:48.445 "devices": [ 00:14:48.445 { 00:14:48.445 "name": "mlx5_0", 00:14:48.445 "polls": 3617455, 00:14:48.445 "idle_polls": 3617262, 00:14:48.445 "completions": 211, 00:14:48.445 "requests": 105, 00:14:48.445 "request_latency": 20883470, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 169, 00:14:48.445 "send_doorbell_updates": 94, 00:14:48.445 "total_recv_wrs": 4201, 00:14:48.445 "recv_doorbell_updates": 94 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "mlx5_1", 00:14:48.445 "polls": 3617455, 00:14:48.445 "idle_polls": 3617455, 00:14:48.445 "completions": 0, 00:14:48.445 "requests": 0, 00:14:48.445 "request_latency": 0, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 0, 00:14:48.445 "send_doorbell_updates": 0, 00:14:48.445 "total_recv_wrs": 4096, 00:14:48.445 "recv_doorbell_updates": 1 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "nvmf_tgt_poll_group_3", 00:14:48.445 "admin_qpairs": 2, 00:14:48.445 "io_qpairs": 26, 00:14:48.445 "current_admin_qpairs": 0, 00:14:48.445 "current_io_qpairs": 0, 00:14:48.445 "pending_bdev_io": 0, 00:14:48.445 "completed_nvme_io": 126, 00:14:48.445 "transports": [ 00:14:48.445 { 00:14:48.445 "trtype": "RDMA", 00:14:48.445 "pending_data_buffer": 0, 00:14:48.445 "devices": [ 00:14:48.445 { 00:14:48.445 "name": "mlx5_0", 00:14:48.445 "polls": 2852177, 00:14:48.445 "idle_polls": 2851861, 00:14:48.445 "completions": 360, 00:14:48.445 "requests": 180, 00:14:48.445 "request_latency": 39240386, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 305, 00:14:48.445 "send_doorbell_updates": 155, 00:14:48.445 "total_recv_wrs": 4276, 00:14:48.445 "recv_doorbell_updates": 156 00:14:48.445 }, 00:14:48.445 { 00:14:48.445 "name": "mlx5_1", 00:14:48.445 "polls": 2852177, 00:14:48.445 "idle_polls": 2852177, 00:14:48.445 "completions": 0, 00:14:48.445 "requests": 0, 00:14:48.445 "request_latency": 0, 00:14:48.445 "pending_free_request": 0, 00:14:48.445 "pending_rdma_read": 0, 00:14:48.445 "pending_rdma_write": 0, 00:14:48.445 "pending_rdma_send": 0, 00:14:48.445 "total_send_wrs": 0, 00:14:48.445 "send_doorbell_updates": 0, 00:14:48.445 "total_recv_wrs": 4096, 00:14:48.445 "recv_doorbell_updates": 1 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 } 00:14:48.445 ] 00:14:48.445 }' 00:14:48.445 21:15:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:48.445 21:15:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:14:48.445 21:15:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:48.445 21:15:42 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:14:48.445 21:15:42 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:14:48.445 21:15:42 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:14:48.445 21:15:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:48.445 21:15:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:14:48.705 21:15:42 -- target/rpc.sh@117 -- # (( 1300 > 0 )) 00:14:48.705 21:15:42 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:14:48.705 21:15:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:14:48.705 21:15:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:14:48.705 21:15:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:48.705 21:15:42 -- target/rpc.sh@118 -- # (( 133995458 > 0 )) 00:14:48.705 21:15:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:14:48.705 21:15:42 -- target/rpc.sh@123 -- # nvmftestfini 00:14:48.705 21:15:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:48.705 21:15:42 -- nvmf/common.sh@117 -- # sync 00:14:48.705 21:15:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:48.705 21:15:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:48.705 21:15:42 -- nvmf/common.sh@120 -- # set +e 00:14:48.705 21:15:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:48.705 21:15:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:48.705 rmmod nvme_rdma 00:14:48.705 rmmod nvme_fabrics 00:14:48.705 21:15:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:48.705 21:15:42 -- nvmf/common.sh@124 -- # set -e 00:14:48.705 21:15:42 -- nvmf/common.sh@125 -- # return 0 00:14:48.705 21:15:42 -- nvmf/common.sh@478 -- # '[' -n 1272165 ']' 00:14:48.705 21:15:42 -- nvmf/common.sh@479 -- # killprocess 1272165 00:14:48.705 21:15:42 -- common/autotest_common.sh@936 -- # '[' -z 1272165 ']' 00:14:48.705 21:15:42 -- common/autotest_common.sh@940 -- # kill -0 1272165 00:14:48.705 21:15:42 -- common/autotest_common.sh@941 -- # uname 00:14:48.705 21:15:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:48.705 21:15:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1272165 00:14:48.705 21:15:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:48.705 21:15:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:48.705 21:15:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1272165' 00:14:48.705 killing process with pid 1272165 00:14:48.705 21:15:42 -- common/autotest_common.sh@955 -- # kill 1272165 00:14:48.705 21:15:42 -- common/autotest_common.sh@960 -- # wait 1272165 00:14:48.705 [2024-04-23 21:15:42.963334] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:48.964 21:15:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:48.964 21:15:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:48.964 00:14:48.964 real 0m35.947s 00:14:48.964 user 2m1.887s 00:14:48.964 sys 0m5.501s 00:14:48.964 21:15:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:48.964 21:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:48.964 ************************************ 00:14:48.964 END TEST nvmf_rpc 00:14:48.964 ************************************ 00:14:48.964 21:15:43 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:14:48.964 21:15:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:48.964 21:15:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:48.964 21:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:49.222 ************************************ 00:14:49.222 START TEST nvmf_invalid 00:14:49.222 ************************************ 00:14:49.222 21:15:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:14:49.222 * Looking for test storage... 00:14:49.222 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:49.222 21:15:43 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:49.222 21:15:43 -- nvmf/common.sh@7 -- # uname -s 00:14:49.222 21:15:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:49.222 21:15:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:49.222 21:15:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:49.222 21:15:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:49.222 21:15:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:49.222 21:15:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:49.222 21:15:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:49.222 21:15:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:49.222 21:15:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:49.222 21:15:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:49.222 21:15:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:49.222 21:15:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:49.222 21:15:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:49.222 21:15:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:49.222 21:15:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:49.222 21:15:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:49.222 21:15:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:49.222 21:15:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:49.222 21:15:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:49.223 21:15:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:49.223 21:15:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.223 21:15:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.223 21:15:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.223 21:15:43 -- paths/export.sh@5 -- # export PATH 00:14:49.223 21:15:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:49.223 21:15:43 -- nvmf/common.sh@47 -- # : 0 00:14:49.223 21:15:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:49.223 21:15:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:49.223 21:15:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:49.223 21:15:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:49.223 21:15:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:49.223 21:15:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:49.223 21:15:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:49.223 21:15:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:49.223 21:15:43 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:14:49.223 21:15:43 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:49.223 21:15:43 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:14:49.223 21:15:43 -- target/invalid.sh@14 -- # target=foobar 00:14:49.223 21:15:43 -- target/invalid.sh@16 -- # RANDOM=0 00:14:49.223 21:15:43 -- target/invalid.sh@34 -- # nvmftestinit 00:14:49.223 21:15:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:49.223 21:15:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:49.223 21:15:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:49.223 21:15:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:49.223 21:15:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:49.223 21:15:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:49.223 21:15:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:49.223 21:15:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:49.223 21:15:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:49.223 21:15:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:49.223 21:15:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:49.223 21:15:43 -- common/autotest_common.sh@10 -- # set +x 00:14:54.586 21:15:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:54.586 21:15:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:54.586 21:15:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:54.586 21:15:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:54.586 21:15:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:54.587 21:15:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:54.587 21:15:48 -- nvmf/common.sh@295 -- # net_devs=() 00:14:54.587 21:15:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@296 -- # e810=() 00:14:54.587 21:15:48 -- nvmf/common.sh@296 -- # local -ga e810 00:14:54.587 21:15:48 -- nvmf/common.sh@297 -- # x722=() 00:14:54.587 21:15:48 -- nvmf/common.sh@297 -- # local -ga x722 00:14:54.587 21:15:48 -- nvmf/common.sh@298 -- # mlx=() 00:14:54.587 21:15:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:54.587 21:15:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:54.587 21:15:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:54.587 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:54.587 21:15:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:54.587 21:15:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:54.587 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:54.587 21:15:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:54.587 21:15:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.587 21:15:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.587 21:15:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:54.587 Found net devices under 0000:18:00.0: mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.587 21:15:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.587 21:15:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:54.587 Found net devices under 0000:18:00.1: mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.587 21:15:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:54.587 21:15:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:54.587 21:15:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:54.587 21:15:48 -- nvmf/common.sh@58 -- # uname 00:14:54.587 21:15:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:54.587 21:15:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:54.587 21:15:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:54.587 21:15:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:54.587 21:15:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:54.587 21:15:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:54.587 21:15:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:54.587 21:15:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:54.587 21:15:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:54.587 21:15:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:54.587 21:15:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:54.587 21:15:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:54.587 21:15:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:54.587 21:15:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@105 -- # continue 2 00:14:54.587 21:15:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@105 -- # continue 2 00:14:54.587 21:15:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:54.587 21:15:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.587 21:15:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:54.587 21:15:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:54.587 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:54.587 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:14:54.587 altname enp24s0f0np0 00:14:54.587 altname ens785f0np0 00:14:54.587 inet 192.168.100.8/24 scope global mlx_0_0 00:14:54.587 valid_lft forever preferred_lft forever 00:14:54.587 21:15:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:54.587 21:15:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.587 21:15:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:54.587 21:15:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:54.587 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:54.587 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:14:54.587 altname enp24s0f1np1 00:14:54.587 altname ens785f1np1 00:14:54.587 inet 192.168.100.9/24 scope global mlx_0_1 00:14:54.587 valid_lft forever preferred_lft forever 00:14:54.587 21:15:48 -- nvmf/common.sh@411 -- # return 0 00:14:54.587 21:15:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:54.587 21:15:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:54.587 21:15:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:54.587 21:15:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:54.587 21:15:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:54.587 21:15:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:54.587 21:15:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:54.587 21:15:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:54.587 21:15:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@105 -- # continue 2 00:14:54.587 21:15:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.587 21:15:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:54.587 21:15:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@105 -- # continue 2 00:14:54.587 21:15:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:54.587 21:15:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.587 21:15:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.587 21:15:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:54.587 21:15:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:54.587 21:15:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:54.588 21:15:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:54.588 21:15:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.588 21:15:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.588 21:15:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:54.588 192.168.100.9' 00:14:54.588 21:15:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:54.588 192.168.100.9' 00:14:54.588 21:15:48 -- nvmf/common.sh@446 -- # head -n 1 00:14:54.588 21:15:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:54.588 21:15:48 -- nvmf/common.sh@447 -- # tail -n +2 00:14:54.588 21:15:48 -- nvmf/common.sh@447 -- # head -n 1 00:14:54.588 21:15:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:54.588 192.168.100.9' 00:14:54.588 21:15:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:54.588 21:15:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:54.588 21:15:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:54.588 21:15:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:54.588 21:15:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:54.588 21:15:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:54.588 21:15:48 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:14:54.588 21:15:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:54.588 21:15:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:54.588 21:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:54.588 21:15:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:54.588 21:15:48 -- nvmf/common.sh@470 -- # nvmfpid=1281063 00:14:54.588 21:15:48 -- nvmf/common.sh@471 -- # waitforlisten 1281063 00:14:54.588 21:15:48 -- common/autotest_common.sh@817 -- # '[' -z 1281063 ']' 00:14:54.588 21:15:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.588 21:15:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:54.588 21:15:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.588 21:15:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:54.588 21:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:54.847 [2024-04-23 21:15:48.859454] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:14:54.847 [2024-04-23 21:15:48.859495] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.847 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.847 [2024-04-23 21:15:48.912671] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:54.847 [2024-04-23 21:15:48.983624] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:54.847 [2024-04-23 21:15:48.983660] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:54.847 [2024-04-23 21:15:48.983668] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:54.847 [2024-04-23 21:15:48.983675] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:54.847 [2024-04-23 21:15:48.983681] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:54.847 [2024-04-23 21:15:48.983726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:54.847 [2024-04-23 21:15:48.983807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:54.847 [2024-04-23 21:15:48.983839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:54.847 [2024-04-23 21:15:48.983843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.414 21:15:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:55.414 21:15:49 -- common/autotest_common.sh@850 -- # return 0 00:14:55.414 21:15:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:55.414 21:15:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:55.414 21:15:49 -- common/autotest_common.sh@10 -- # set +x 00:14:55.673 21:15:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.673 21:15:49 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:55.673 21:15:49 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode26117 00:14:55.673 [2024-04-23 21:15:49.825431] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:14:55.673 21:15:49 -- target/invalid.sh@40 -- # out='request: 00:14:55.673 { 00:14:55.673 "nqn": "nqn.2016-06.io.spdk:cnode26117", 00:14:55.673 "tgt_name": "foobar", 00:14:55.673 "method": "nvmf_create_subsystem", 00:14:55.673 "req_id": 1 00:14:55.673 } 00:14:55.673 Got JSON-RPC error response 00:14:55.673 response: 00:14:55.673 { 00:14:55.673 "code": -32603, 00:14:55.673 "message": "Unable to find target foobar" 00:14:55.673 }' 00:14:55.673 21:15:49 -- target/invalid.sh@41 -- # [[ request: 00:14:55.673 { 00:14:55.673 "nqn": "nqn.2016-06.io.spdk:cnode26117", 00:14:55.673 "tgt_name": "foobar", 00:14:55.673 "method": "nvmf_create_subsystem", 00:14:55.673 "req_id": 1 00:14:55.673 } 00:14:55.673 Got JSON-RPC error response 00:14:55.673 response: 00:14:55.673 { 00:14:55.673 "code": -32603, 00:14:55.673 "message": "Unable to find target foobar" 00:14:55.673 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:14:55.673 21:15:49 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:14:55.673 21:15:49 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode20691 00:14:55.932 [2024-04-23 21:15:49.993969] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20691: invalid serial number 'SPDKISFASTANDAWESOME' 00:14:55.932 21:15:50 -- target/invalid.sh@45 -- # out='request: 00:14:55.932 { 00:14:55.932 "nqn": "nqn.2016-06.io.spdk:cnode20691", 00:14:55.932 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:55.932 "method": "nvmf_create_subsystem", 00:14:55.932 "req_id": 1 00:14:55.932 } 00:14:55.932 Got JSON-RPC error response 00:14:55.932 response: 00:14:55.932 { 00:14:55.932 "code": -32602, 00:14:55.932 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:55.932 }' 00:14:55.932 21:15:50 -- target/invalid.sh@46 -- # [[ request: 00:14:55.932 { 00:14:55.932 "nqn": "nqn.2016-06.io.spdk:cnode20691", 00:14:55.932 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:55.932 "method": "nvmf_create_subsystem", 00:14:55.932 "req_id": 1 00:14:55.932 } 00:14:55.932 Got JSON-RPC error response 00:14:55.932 response: 00:14:55.932 { 00:14:55.932 "code": -32602, 00:14:55.932 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:55.932 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:55.932 21:15:50 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:14:55.932 21:15:50 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode32553 00:14:55.932 [2024-04-23 21:15:50.158521] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32553: invalid model number 'SPDK_Controller' 00:14:55.932 21:15:50 -- target/invalid.sh@50 -- # out='request: 00:14:55.932 { 00:14:55.932 "nqn": "nqn.2016-06.io.spdk:cnode32553", 00:14:55.932 "model_number": "SPDK_Controller\u001f", 00:14:55.932 "method": "nvmf_create_subsystem", 00:14:55.932 "req_id": 1 00:14:55.932 } 00:14:55.932 Got JSON-RPC error response 00:14:55.932 response: 00:14:55.932 { 00:14:55.932 "code": -32602, 00:14:55.932 "message": "Invalid MN SPDK_Controller\u001f" 00:14:55.932 }' 00:14:55.932 21:15:50 -- target/invalid.sh@51 -- # [[ request: 00:14:55.932 { 00:14:55.932 "nqn": "nqn.2016-06.io.spdk:cnode32553", 00:14:55.932 "model_number": "SPDK_Controller\u001f", 00:14:55.932 "method": "nvmf_create_subsystem", 00:14:55.932 "req_id": 1 00:14:55.932 } 00:14:55.932 Got JSON-RPC error response 00:14:55.932 response: 00:14:55.932 { 00:14:55.932 "code": -32602, 00:14:55.932 "message": "Invalid MN SPDK_Controller\u001f" 00:14:55.932 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:55.932 21:15:50 -- target/invalid.sh@54 -- # gen_random_s 21 00:14:55.932 21:15:50 -- target/invalid.sh@19 -- # local length=21 ll 00:14:55.932 21:15:50 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:55.932 21:15:50 -- target/invalid.sh@21 -- # local chars 00:14:55.932 21:15:50 -- target/invalid.sh@22 -- # local string 00:14:55.932 21:15:50 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:55.932 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:55.932 21:15:50 -- target/invalid.sh@25 -- # printf %x 53 00:14:55.932 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x35' 00:14:55.932 21:15:50 -- target/invalid.sh@25 -- # string+=5 00:14:55.932 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:55.932 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:55.932 21:15:50 -- target/invalid.sh@25 -- # printf %x 125 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+='}' 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 63 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+='?' 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 124 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+='|' 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 118 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x76' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=v 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 59 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=';' 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 44 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=, 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 115 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x73' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=s 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 62 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+='>' 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 69 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x45' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=E 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 76 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=L 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 98 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x62' 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # string+=b 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.191 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # printf %x 62 00:14:56.191 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+='>' 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 58 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=: 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 93 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=']' 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 107 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=k 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 42 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+='*' 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 75 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=K 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 101 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x65' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=e 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 69 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x45' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=E 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # printf %x 58 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:14:56.192 21:15:50 -- target/invalid.sh@25 -- # string+=: 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.192 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.192 21:15:50 -- target/invalid.sh@28 -- # [[ 5 == \- ]] 00:14:56.192 21:15:50 -- target/invalid.sh@31 -- # echo '5}?|v;,s>ELb>:]k*KeE:' 00:14:56.192 21:15:50 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '5}?|v;,s>ELb>:]k*KeE:' nqn.2016-06.io.spdk:cnode15535 00:14:56.192 [2024-04-23 21:15:50.459516] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15535: invalid serial number '5}?|v;,s>ELb>:]k*KeE:' 00:14:56.451 21:15:50 -- target/invalid.sh@54 -- # out='request: 00:14:56.451 { 00:14:56.451 "nqn": "nqn.2016-06.io.spdk:cnode15535", 00:14:56.451 "serial_number": "5}?|v;,s>ELb>:]k*KeE:", 00:14:56.451 "method": "nvmf_create_subsystem", 00:14:56.451 "req_id": 1 00:14:56.451 } 00:14:56.451 Got JSON-RPC error response 00:14:56.451 response: 00:14:56.451 { 00:14:56.451 "code": -32602, 00:14:56.451 "message": "Invalid SN 5}?|v;,s>ELb>:]k*KeE:" 00:14:56.451 }' 00:14:56.451 21:15:50 -- target/invalid.sh@55 -- # [[ request: 00:14:56.451 { 00:14:56.451 "nqn": "nqn.2016-06.io.spdk:cnode15535", 00:14:56.451 "serial_number": "5}?|v;,s>ELb>:]k*KeE:", 00:14:56.451 "method": "nvmf_create_subsystem", 00:14:56.451 "req_id": 1 00:14:56.451 } 00:14:56.451 Got JSON-RPC error response 00:14:56.451 response: 00:14:56.451 { 00:14:56.451 "code": -32602, 00:14:56.451 "message": "Invalid SN 5}?|v;,s>ELb>:]k*KeE:" 00:14:56.451 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:56.451 21:15:50 -- target/invalid.sh@58 -- # gen_random_s 41 00:14:56.451 21:15:50 -- target/invalid.sh@19 -- # local length=41 ll 00:14:56.452 21:15:50 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:56.452 21:15:50 -- target/invalid.sh@21 -- # local chars 00:14:56.452 21:15:50 -- target/invalid.sh@22 -- # local string 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 38 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x26' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+='&' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 76 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=L 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 108 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=l 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 124 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+='|' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 61 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+== 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 44 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=, 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 74 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=J 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 72 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x48' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=H 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 58 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=: 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 107 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=k 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 52 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x34' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=4 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 42 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+='*' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 52 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x34' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=4 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 121 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x79' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=y 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 35 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x23' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+='#' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 110 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=n 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 113 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=q 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 78 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=N 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 102 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x66' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=f 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 125 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+='}' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 113 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=q 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 65 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x41' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=A 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 97 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x61' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=a 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 32 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x20' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=' ' 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 106 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=j 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 65 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x41' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=A 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 106 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=j 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 111 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=o 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.452 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # printf %x 100 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x64' 00:14:56.452 21:15:50 -- target/invalid.sh@25 -- # string+=d 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 122 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=z 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 109 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=m 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 80 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x50' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=P 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 110 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=n 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 34 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x22' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+='"' 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 103 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x67' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=g 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 113 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=q 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 107 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=k 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 126 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+='~' 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 78 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=N 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 41 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x29' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=')' 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # printf %x 109 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:14:56.453 21:15:50 -- target/invalid.sh@25 -- # string+=m 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:56.453 21:15:50 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:56.453 21:15:50 -- target/invalid.sh@28 -- # [[ & == \- ]] 00:14:56.453 21:15:50 -- target/invalid.sh@31 -- # echo '&Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn"gqk~N)m' 00:14:56.712 21:15:50 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '&Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn"gqk~N)m' nqn.2016-06.io.spdk:cnode21167 00:14:56.712 [2024-04-23 21:15:50.868862] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21167: invalid model number '&Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn"gqk~N)m' 00:14:56.712 21:15:50 -- target/invalid.sh@58 -- # out='request: 00:14:56.712 { 00:14:56.712 "nqn": "nqn.2016-06.io.spdk:cnode21167", 00:14:56.712 "model_number": "&Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn\"gqk~N)m", 00:14:56.712 "method": "nvmf_create_subsystem", 00:14:56.712 "req_id": 1 00:14:56.712 } 00:14:56.712 Got JSON-RPC error response 00:14:56.712 response: 00:14:56.712 { 00:14:56.712 "code": -32602, 00:14:56.712 "message": "Invalid MN &Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn\"gqk~N)m" 00:14:56.712 }' 00:14:56.712 21:15:50 -- target/invalid.sh@59 -- # [[ request: 00:14:56.712 { 00:14:56.712 "nqn": "nqn.2016-06.io.spdk:cnode21167", 00:14:56.712 "model_number": "&Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn\"gqk~N)m", 00:14:56.712 "method": "nvmf_create_subsystem", 00:14:56.712 "req_id": 1 00:14:56.712 } 00:14:56.712 Got JSON-RPC error response 00:14:56.712 response: 00:14:56.712 { 00:14:56.712 "code": -32602, 00:14:56.712 "message": "Invalid MN &Ll|=,JH:k4*4y#nqNf}qAa jAjodzmPn\"gqk~N)m" 00:14:56.712 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:56.712 21:15:50 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:14:56.971 [2024-04-23 21:15:51.066166] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xa17d70/0xa1c260) succeed. 00:14:56.971 [2024-04-23 21:15:51.075515] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa193b0/0xa5d8f0) succeed. 00:14:56.971 21:15:51 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:14:57.229 21:15:51 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:14:57.229 21:15:51 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:14:57.229 192.168.100.9' 00:14:57.229 21:15:51 -- target/invalid.sh@67 -- # head -n 1 00:14:57.229 21:15:51 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:14:57.229 21:15:51 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:14:57.489 [2024-04-23 21:15:51.521731] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:14:57.489 21:15:51 -- target/invalid.sh@69 -- # out='request: 00:14:57.489 { 00:14:57.489 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:57.489 "listen_address": { 00:14:57.489 "trtype": "rdma", 00:14:57.489 "traddr": "192.168.100.8", 00:14:57.489 "trsvcid": "4421" 00:14:57.489 }, 00:14:57.489 "method": "nvmf_subsystem_remove_listener", 00:14:57.489 "req_id": 1 00:14:57.489 } 00:14:57.489 Got JSON-RPC error response 00:14:57.489 response: 00:14:57.489 { 00:14:57.489 "code": -32602, 00:14:57.489 "message": "Invalid parameters" 00:14:57.489 }' 00:14:57.489 21:15:51 -- target/invalid.sh@70 -- # [[ request: 00:14:57.489 { 00:14:57.489 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:57.489 "listen_address": { 00:14:57.489 "trtype": "rdma", 00:14:57.489 "traddr": "192.168.100.8", 00:14:57.489 "trsvcid": "4421" 00:14:57.489 }, 00:14:57.489 "method": "nvmf_subsystem_remove_listener", 00:14:57.489 "req_id": 1 00:14:57.489 } 00:14:57.489 Got JSON-RPC error response 00:14:57.489 response: 00:14:57.489 { 00:14:57.489 "code": -32602, 00:14:57.489 "message": "Invalid parameters" 00:14:57.489 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:14:57.489 21:15:51 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11867 -i 0 00:14:57.489 [2024-04-23 21:15:51.690297] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11867: invalid cntlid range [0-65519] 00:14:57.489 21:15:51 -- target/invalid.sh@73 -- # out='request: 00:14:57.489 { 00:14:57.489 "nqn": "nqn.2016-06.io.spdk:cnode11867", 00:14:57.489 "min_cntlid": 0, 00:14:57.489 "method": "nvmf_create_subsystem", 00:14:57.489 "req_id": 1 00:14:57.489 } 00:14:57.489 Got JSON-RPC error response 00:14:57.489 response: 00:14:57.489 { 00:14:57.489 "code": -32602, 00:14:57.489 "message": "Invalid cntlid range [0-65519]" 00:14:57.489 }' 00:14:57.489 21:15:51 -- target/invalid.sh@74 -- # [[ request: 00:14:57.489 { 00:14:57.489 "nqn": "nqn.2016-06.io.spdk:cnode11867", 00:14:57.489 "min_cntlid": 0, 00:14:57.489 "method": "nvmf_create_subsystem", 00:14:57.489 "req_id": 1 00:14:57.489 } 00:14:57.489 Got JSON-RPC error response 00:14:57.489 response: 00:14:57.489 { 00:14:57.489 "code": -32602, 00:14:57.489 "message": "Invalid cntlid range [0-65519]" 00:14:57.489 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:57.489 21:15:51 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22474 -i 65520 00:14:57.748 [2024-04-23 21:15:51.850848] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22474: invalid cntlid range [65520-65519] 00:14:57.748 21:15:51 -- target/invalid.sh@75 -- # out='request: 00:14:57.748 { 00:14:57.748 "nqn": "nqn.2016-06.io.spdk:cnode22474", 00:14:57.748 "min_cntlid": 65520, 00:14:57.748 "method": "nvmf_create_subsystem", 00:14:57.748 "req_id": 1 00:14:57.748 } 00:14:57.748 Got JSON-RPC error response 00:14:57.748 response: 00:14:57.748 { 00:14:57.748 "code": -32602, 00:14:57.748 "message": "Invalid cntlid range [65520-65519]" 00:14:57.748 }' 00:14:57.748 21:15:51 -- target/invalid.sh@76 -- # [[ request: 00:14:57.748 { 00:14:57.748 "nqn": "nqn.2016-06.io.spdk:cnode22474", 00:14:57.748 "min_cntlid": 65520, 00:14:57.748 "method": "nvmf_create_subsystem", 00:14:57.748 "req_id": 1 00:14:57.748 } 00:14:57.748 Got JSON-RPC error response 00:14:57.748 response: 00:14:57.748 { 00:14:57.748 "code": -32602, 00:14:57.748 "message": "Invalid cntlid range [65520-65519]" 00:14:57.748 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:57.748 21:15:51 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9578 -I 0 00:14:57.748 [2024-04-23 21:15:52.011449] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9578: invalid cntlid range [1-0] 00:14:58.007 21:15:52 -- target/invalid.sh@77 -- # out='request: 00:14:58.007 { 00:14:58.007 "nqn": "nqn.2016-06.io.spdk:cnode9578", 00:14:58.007 "max_cntlid": 0, 00:14:58.007 "method": "nvmf_create_subsystem", 00:14:58.007 "req_id": 1 00:14:58.007 } 00:14:58.007 Got JSON-RPC error response 00:14:58.007 response: 00:14:58.007 { 00:14:58.007 "code": -32602, 00:14:58.007 "message": "Invalid cntlid range [1-0]" 00:14:58.007 }' 00:14:58.007 21:15:52 -- target/invalid.sh@78 -- # [[ request: 00:14:58.007 { 00:14:58.007 "nqn": "nqn.2016-06.io.spdk:cnode9578", 00:14:58.007 "max_cntlid": 0, 00:14:58.007 "method": "nvmf_create_subsystem", 00:14:58.007 "req_id": 1 00:14:58.007 } 00:14:58.007 Got JSON-RPC error response 00:14:58.007 response: 00:14:58.007 { 00:14:58.007 "code": -32602, 00:14:58.007 "message": "Invalid cntlid range [1-0]" 00:14:58.007 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:58.007 21:15:52 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10670 -I 65520 00:14:58.007 [2024-04-23 21:15:52.188121] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10670: invalid cntlid range [1-65520] 00:14:58.007 21:15:52 -- target/invalid.sh@79 -- # out='request: 00:14:58.007 { 00:14:58.007 "nqn": "nqn.2016-06.io.spdk:cnode10670", 00:14:58.007 "max_cntlid": 65520, 00:14:58.008 "method": "nvmf_create_subsystem", 00:14:58.008 "req_id": 1 00:14:58.008 } 00:14:58.008 Got JSON-RPC error response 00:14:58.008 response: 00:14:58.008 { 00:14:58.008 "code": -32602, 00:14:58.008 "message": "Invalid cntlid range [1-65520]" 00:14:58.008 }' 00:14:58.008 21:15:52 -- target/invalid.sh@80 -- # [[ request: 00:14:58.008 { 00:14:58.008 "nqn": "nqn.2016-06.io.spdk:cnode10670", 00:14:58.008 "max_cntlid": 65520, 00:14:58.008 "method": "nvmf_create_subsystem", 00:14:58.008 "req_id": 1 00:14:58.008 } 00:14:58.008 Got JSON-RPC error response 00:14:58.008 response: 00:14:58.008 { 00:14:58.008 "code": -32602, 00:14:58.008 "message": "Invalid cntlid range [1-65520]" 00:14:58.008 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:58.008 21:15:52 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode849 -i 6 -I 5 00:14:58.267 [2024-04-23 21:15:52.360727] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode849: invalid cntlid range [6-5] 00:14:58.267 21:15:52 -- target/invalid.sh@83 -- # out='request: 00:14:58.267 { 00:14:58.267 "nqn": "nqn.2016-06.io.spdk:cnode849", 00:14:58.267 "min_cntlid": 6, 00:14:58.267 "max_cntlid": 5, 00:14:58.267 "method": "nvmf_create_subsystem", 00:14:58.267 "req_id": 1 00:14:58.267 } 00:14:58.267 Got JSON-RPC error response 00:14:58.267 response: 00:14:58.267 { 00:14:58.267 "code": -32602, 00:14:58.267 "message": "Invalid cntlid range [6-5]" 00:14:58.267 }' 00:14:58.267 21:15:52 -- target/invalid.sh@84 -- # [[ request: 00:14:58.267 { 00:14:58.267 "nqn": "nqn.2016-06.io.spdk:cnode849", 00:14:58.267 "min_cntlid": 6, 00:14:58.267 "max_cntlid": 5, 00:14:58.267 "method": "nvmf_create_subsystem", 00:14:58.267 "req_id": 1 00:14:58.267 } 00:14:58.267 Got JSON-RPC error response 00:14:58.267 response: 00:14:58.267 { 00:14:58.267 "code": -32602, 00:14:58.267 "message": "Invalid cntlid range [6-5]" 00:14:58.267 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:58.267 21:15:52 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:14:58.267 21:15:52 -- target/invalid.sh@87 -- # out='request: 00:14:58.267 { 00:14:58.267 "name": "foobar", 00:14:58.267 "method": "nvmf_delete_target", 00:14:58.267 "req_id": 1 00:14:58.267 } 00:14:58.267 Got JSON-RPC error response 00:14:58.267 response: 00:14:58.267 { 00:14:58.267 "code": -32602, 00:14:58.267 "message": "The specified target doesn'\''t exist, cannot delete it." 00:14:58.267 }' 00:14:58.267 21:15:52 -- target/invalid.sh@88 -- # [[ request: 00:14:58.267 { 00:14:58.267 "name": "foobar", 00:14:58.267 "method": "nvmf_delete_target", 00:14:58.267 "req_id": 1 00:14:58.267 } 00:14:58.267 Got JSON-RPC error response 00:14:58.267 response: 00:14:58.267 { 00:14:58.267 "code": -32602, 00:14:58.267 "message": "The specified target doesn't exist, cannot delete it." 00:14:58.267 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:14:58.267 21:15:52 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:14:58.267 21:15:52 -- target/invalid.sh@91 -- # nvmftestfini 00:14:58.267 21:15:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:58.267 21:15:52 -- nvmf/common.sh@117 -- # sync 00:14:58.267 21:15:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:58.267 21:15:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:58.267 21:15:52 -- nvmf/common.sh@120 -- # set +e 00:14:58.267 21:15:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:58.267 21:15:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:58.267 rmmod nvme_rdma 00:14:58.267 rmmod nvme_fabrics 00:14:58.267 21:15:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:58.267 21:15:52 -- nvmf/common.sh@124 -- # set -e 00:14:58.267 21:15:52 -- nvmf/common.sh@125 -- # return 0 00:14:58.267 21:15:52 -- nvmf/common.sh@478 -- # '[' -n 1281063 ']' 00:14:58.267 21:15:52 -- nvmf/common.sh@479 -- # killprocess 1281063 00:14:58.267 21:15:52 -- common/autotest_common.sh@936 -- # '[' -z 1281063 ']' 00:14:58.267 21:15:52 -- common/autotest_common.sh@940 -- # kill -0 1281063 00:14:58.267 21:15:52 -- common/autotest_common.sh@941 -- # uname 00:14:58.268 21:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:58.268 21:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1281063 00:14:58.527 21:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:58.527 21:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:58.527 21:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1281063' 00:14:58.527 killing process with pid 1281063 00:14:58.527 21:15:52 -- common/autotest_common.sh@955 -- # kill 1281063 00:14:58.527 21:15:52 -- common/autotest_common.sh@960 -- # wait 1281063 00:14:58.527 [2024-04-23 21:15:52.650796] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:58.794 21:15:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:58.794 21:15:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:58.794 00:14:58.794 real 0m9.500s 00:14:58.794 user 0m18.768s 00:14:58.794 sys 0m4.983s 00:14:58.794 21:15:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:58.794 21:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:58.794 ************************************ 00:14:58.794 END TEST nvmf_invalid 00:14:58.794 ************************************ 00:14:58.794 21:15:52 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:14:58.794 21:15:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:58.794 21:15:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:58.794 21:15:52 -- common/autotest_common.sh@10 -- # set +x 00:14:58.794 ************************************ 00:14:58.794 START TEST nvmf_abort 00:14:58.794 ************************************ 00:14:58.794 21:15:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:14:59.064 * Looking for test storage... 00:14:59.064 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:59.064 21:15:53 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:59.064 21:15:53 -- nvmf/common.sh@7 -- # uname -s 00:14:59.064 21:15:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:59.064 21:15:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:59.064 21:15:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:59.064 21:15:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:59.064 21:15:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:59.064 21:15:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:59.064 21:15:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:59.064 21:15:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:59.064 21:15:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:59.064 21:15:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:59.064 21:15:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:59.064 21:15:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:59.064 21:15:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:59.064 21:15:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:59.064 21:15:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:59.064 21:15:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:59.064 21:15:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:59.064 21:15:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:59.064 21:15:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:59.064 21:15:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:59.064 21:15:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:59.064 21:15:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:59.064 21:15:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:59.064 21:15:53 -- paths/export.sh@5 -- # export PATH 00:14:59.064 21:15:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:59.064 21:15:53 -- nvmf/common.sh@47 -- # : 0 00:14:59.064 21:15:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:59.064 21:15:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:59.064 21:15:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:59.064 21:15:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:59.064 21:15:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:59.064 21:15:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:59.064 21:15:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:59.064 21:15:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:59.064 21:15:53 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:59.064 21:15:53 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:14:59.064 21:15:53 -- target/abort.sh@14 -- # nvmftestinit 00:14:59.064 21:15:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:59.064 21:15:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:59.064 21:15:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:59.064 21:15:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:59.064 21:15:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:59.065 21:15:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:59.065 21:15:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:59.065 21:15:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:59.065 21:15:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:59.065 21:15:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:59.065 21:15:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:59.065 21:15:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.341 21:15:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:04.341 21:15:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:04.341 21:15:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:04.341 21:15:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:04.341 21:15:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:04.341 21:15:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:04.341 21:15:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:04.341 21:15:58 -- nvmf/common.sh@295 -- # net_devs=() 00:15:04.341 21:15:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:04.341 21:15:58 -- nvmf/common.sh@296 -- # e810=() 00:15:04.341 21:15:58 -- nvmf/common.sh@296 -- # local -ga e810 00:15:04.341 21:15:58 -- nvmf/common.sh@297 -- # x722=() 00:15:04.341 21:15:58 -- nvmf/common.sh@297 -- # local -ga x722 00:15:04.341 21:15:58 -- nvmf/common.sh@298 -- # mlx=() 00:15:04.341 21:15:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:04.341 21:15:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:04.341 21:15:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:04.341 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:04.341 21:15:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:04.341 21:15:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:04.341 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:04.341 21:15:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:04.341 21:15:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.341 21:15:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.341 21:15:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:04.341 Found net devices under 0000:18:00.0: mlx_0_0 00:15:04.341 21:15:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.341 21:15:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.341 21:15:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:04.341 Found net devices under 0000:18:00.1: mlx_0_1 00:15:04.341 21:15:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.341 21:15:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:04.341 21:15:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:04.341 21:15:58 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:04.341 21:15:58 -- nvmf/common.sh@58 -- # uname 00:15:04.341 21:15:58 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:04.341 21:15:58 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:04.341 21:15:58 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:04.341 21:15:58 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:04.341 21:15:58 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:04.341 21:15:58 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:04.341 21:15:58 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:04.341 21:15:58 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:04.341 21:15:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:04.341 21:15:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:04.341 21:15:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:04.341 21:15:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:04.341 21:15:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:04.341 21:15:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:04.341 21:15:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:04.341 21:15:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:04.341 21:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:04.341 21:15:58 -- nvmf/common.sh@105 -- # continue 2 00:15:04.341 21:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.341 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:04.341 21:15:58 -- nvmf/common.sh@105 -- # continue 2 00:15:04.341 21:15:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:04.341 21:15:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:04.341 21:15:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:04.341 21:15:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:04.341 21:15:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:04.341 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:04.341 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:04.341 altname enp24s0f0np0 00:15:04.341 altname ens785f0np0 00:15:04.341 inet 192.168.100.8/24 scope global mlx_0_0 00:15:04.341 valid_lft forever preferred_lft forever 00:15:04.341 21:15:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:04.341 21:15:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:04.341 21:15:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:04.341 21:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:04.341 21:15:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:04.341 21:15:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:04.341 21:15:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:04.341 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:04.341 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:04.341 altname enp24s0f1np1 00:15:04.342 altname ens785f1np1 00:15:04.342 inet 192.168.100.9/24 scope global mlx_0_1 00:15:04.342 valid_lft forever preferred_lft forever 00:15:04.342 21:15:58 -- nvmf/common.sh@411 -- # return 0 00:15:04.342 21:15:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:04.342 21:15:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:04.342 21:15:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:04.342 21:15:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:04.342 21:15:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:04.342 21:15:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:04.342 21:15:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:04.342 21:15:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:04.342 21:15:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:04.342 21:15:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:04.342 21:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:04.342 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.342 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:04.342 21:15:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:04.342 21:15:58 -- nvmf/common.sh@105 -- # continue 2 00:15:04.342 21:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:04.342 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.342 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:04.342 21:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:04.342 21:15:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:04.342 21:15:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:04.342 21:15:58 -- nvmf/common.sh@105 -- # continue 2 00:15:04.342 21:15:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:04.342 21:15:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:04.342 21:15:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:04.342 21:15:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:04.342 21:15:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:04.342 21:15:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:04.342 21:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:04.342 21:15:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:04.342 192.168.100.9' 00:15:04.342 21:15:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:04.342 192.168.100.9' 00:15:04.342 21:15:58 -- nvmf/common.sh@446 -- # head -n 1 00:15:04.342 21:15:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:04.342 21:15:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:04.342 192.168.100.9' 00:15:04.342 21:15:58 -- nvmf/common.sh@447 -- # tail -n +2 00:15:04.342 21:15:58 -- nvmf/common.sh@447 -- # head -n 1 00:15:04.342 21:15:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:04.342 21:15:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:04.342 21:15:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:04.342 21:15:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:04.342 21:15:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:04.342 21:15:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:04.342 21:15:58 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:15:04.342 21:15:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:04.342 21:15:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:04.342 21:15:58 -- common/autotest_common.sh@10 -- # set +x 00:15:04.342 21:15:58 -- nvmf/common.sh@470 -- # nvmfpid=1285270 00:15:04.342 21:15:58 -- nvmf/common.sh@471 -- # waitforlisten 1285270 00:15:04.342 21:15:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:04.342 21:15:58 -- common/autotest_common.sh@817 -- # '[' -z 1285270 ']' 00:15:04.342 21:15:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:04.342 21:15:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:04.342 21:15:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:04.342 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:04.342 21:15:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:04.342 21:15:58 -- common/autotest_common.sh@10 -- # set +x 00:15:04.342 [2024-04-23 21:15:58.347881] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:15:04.342 [2024-04-23 21:15:58.347925] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:04.342 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.342 [2024-04-23 21:15:58.399191] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:04.342 [2024-04-23 21:15:58.467382] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.342 [2024-04-23 21:15:58.467426] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.342 [2024-04-23 21:15:58.467433] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:04.342 [2024-04-23 21:15:58.467438] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:04.342 [2024-04-23 21:15:58.467443] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.342 [2024-04-23 21:15:58.467577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:04.342 [2024-04-23 21:15:58.467666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:04.342 [2024-04-23 21:15:58.467667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:04.911 21:15:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:04.911 21:15:59 -- common/autotest_common.sh@850 -- # return 0 00:15:04.911 21:15:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:04.911 21:15:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:04.911 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:04.911 21:15:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:04.911 21:15:59 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:15:04.911 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:04.911 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 [2024-04-23 21:15:59.185382] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2493ed0/0x24983c0) succeed. 00:15:05.171 [2024-04-23 21:15:59.194572] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2495470/0x24d9a50) succeed. 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 Malloc0 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 Delay0 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 [2024-04-23 21:15:59.351006] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:05.171 21:15:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.171 21:15:59 -- common/autotest_common.sh@10 -- # set +x 00:15:05.171 21:15:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.171 21:15:59 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:15:05.171 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.171 [2024-04-23 21:15:59.436149] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:07.707 Initializing NVMe Controllers 00:15:07.707 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:15:07.707 controller IO queue size 128 less than required 00:15:07.707 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:15:07.707 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:15:07.707 Initialization complete. Launching workers. 00:15:07.707 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 57581 00:15:07.707 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 57642, failed to submit 62 00:15:07.707 success 57582, unsuccess 60, failed 0 00:15:07.707 21:16:01 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:07.707 21:16:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.707 21:16:01 -- common/autotest_common.sh@10 -- # set +x 00:15:07.707 21:16:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.707 21:16:01 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:15:07.707 21:16:01 -- target/abort.sh@38 -- # nvmftestfini 00:15:07.707 21:16:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:07.707 21:16:01 -- nvmf/common.sh@117 -- # sync 00:15:07.707 21:16:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:07.707 21:16:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:07.707 21:16:01 -- nvmf/common.sh@120 -- # set +e 00:15:07.707 21:16:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:07.707 21:16:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:07.707 rmmod nvme_rdma 00:15:07.707 rmmod nvme_fabrics 00:15:07.707 21:16:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:07.707 21:16:01 -- nvmf/common.sh@124 -- # set -e 00:15:07.707 21:16:01 -- nvmf/common.sh@125 -- # return 0 00:15:07.707 21:16:01 -- nvmf/common.sh@478 -- # '[' -n 1285270 ']' 00:15:07.707 21:16:01 -- nvmf/common.sh@479 -- # killprocess 1285270 00:15:07.707 21:16:01 -- common/autotest_common.sh@936 -- # '[' -z 1285270 ']' 00:15:07.707 21:16:01 -- common/autotest_common.sh@940 -- # kill -0 1285270 00:15:07.707 21:16:01 -- common/autotest_common.sh@941 -- # uname 00:15:07.707 21:16:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:07.707 21:16:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1285270 00:15:07.707 21:16:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:07.707 21:16:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:07.707 21:16:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1285270' 00:15:07.707 killing process with pid 1285270 00:15:07.708 21:16:01 -- common/autotest_common.sh@955 -- # kill 1285270 00:15:07.708 21:16:01 -- common/autotest_common.sh@960 -- # wait 1285270 00:15:07.708 [2024-04-23 21:16:01.703268] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:07.708 21:16:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:07.708 21:16:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:07.708 00:15:07.708 real 0m8.910s 00:15:07.708 user 0m13.764s 00:15:07.708 sys 0m4.331s 00:15:07.708 21:16:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:07.708 21:16:01 -- common/autotest_common.sh@10 -- # set +x 00:15:07.708 ************************************ 00:15:07.708 END TEST nvmf_abort 00:15:07.708 ************************************ 00:15:07.708 21:16:01 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:15:07.708 21:16:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:07.708 21:16:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:07.708 21:16:01 -- common/autotest_common.sh@10 -- # set +x 00:15:07.967 ************************************ 00:15:07.967 START TEST nvmf_ns_hotplug_stress 00:15:07.967 ************************************ 00:15:07.967 21:16:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:15:07.967 * Looking for test storage... 00:15:07.967 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:07.967 21:16:02 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:07.967 21:16:02 -- nvmf/common.sh@7 -- # uname -s 00:15:07.967 21:16:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:07.967 21:16:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:07.967 21:16:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:07.967 21:16:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:07.967 21:16:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:07.967 21:16:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:07.967 21:16:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:07.967 21:16:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:07.967 21:16:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:07.967 21:16:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:07.967 21:16:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:15:07.967 21:16:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:15:07.967 21:16:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:07.967 21:16:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:07.967 21:16:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:07.967 21:16:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:07.967 21:16:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:07.967 21:16:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:07.967 21:16:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:07.967 21:16:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:07.967 21:16:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.967 21:16:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.967 21:16:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.967 21:16:02 -- paths/export.sh@5 -- # export PATH 00:15:07.967 21:16:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:07.967 21:16:02 -- nvmf/common.sh@47 -- # : 0 00:15:07.967 21:16:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:07.967 21:16:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:07.967 21:16:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:07.967 21:16:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:07.967 21:16:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:07.967 21:16:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:07.967 21:16:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:07.967 21:16:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:07.967 21:16:02 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:07.967 21:16:02 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:15:07.967 21:16:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:07.967 21:16:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:07.967 21:16:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:07.967 21:16:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:07.967 21:16:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:07.967 21:16:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:07.967 21:16:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:07.967 21:16:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:07.968 21:16:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:07.968 21:16:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:07.968 21:16:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:07.968 21:16:02 -- common/autotest_common.sh@10 -- # set +x 00:15:13.278 21:16:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.278 21:16:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:13.278 21:16:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:13.278 21:16:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:13.278 21:16:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:13.278 21:16:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:13.278 21:16:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:13.278 21:16:07 -- nvmf/common.sh@295 -- # net_devs=() 00:15:13.278 21:16:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:13.278 21:16:07 -- nvmf/common.sh@296 -- # e810=() 00:15:13.278 21:16:07 -- nvmf/common.sh@296 -- # local -ga e810 00:15:13.278 21:16:07 -- nvmf/common.sh@297 -- # x722=() 00:15:13.278 21:16:07 -- nvmf/common.sh@297 -- # local -ga x722 00:15:13.278 21:16:07 -- nvmf/common.sh@298 -- # mlx=() 00:15:13.278 21:16:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:13.278 21:16:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.278 21:16:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:13.278 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:13.278 21:16:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.278 21:16:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:13.278 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:13.278 21:16:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.278 21:16:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.278 21:16:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.278 21:16:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:13.278 Found net devices under 0000:18:00.0: mlx_0_0 00:15:13.278 21:16:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.278 21:16:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.278 21:16:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:13.278 Found net devices under 0000:18:00.1: mlx_0_1 00:15:13.278 21:16:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.278 21:16:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:13.278 21:16:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:13.278 21:16:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:13.278 21:16:07 -- nvmf/common.sh@58 -- # uname 00:15:13.278 21:16:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:13.278 21:16:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:13.278 21:16:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:13.278 21:16:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:13.278 21:16:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:13.278 21:16:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:13.278 21:16:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:13.278 21:16:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:13.278 21:16:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:13.278 21:16:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:13.278 21:16:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:13.278 21:16:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.278 21:16:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.278 21:16:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.278 21:16:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.278 21:16:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.278 21:16:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.278 21:16:07 -- nvmf/common.sh@105 -- # continue 2 00:15:13.278 21:16:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.278 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.278 21:16:07 -- nvmf/common.sh@105 -- # continue 2 00:15:13.278 21:16:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.278 21:16:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:13.278 21:16:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.278 21:16:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.278 21:16:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.278 21:16:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.278 21:16:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:13.278 21:16:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:13.278 21:16:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:13.278 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.278 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:13.278 altname enp24s0f0np0 00:15:13.278 altname ens785f0np0 00:15:13.279 inet 192.168.100.8/24 scope global mlx_0_0 00:15:13.279 valid_lft forever preferred_lft forever 00:15:13.279 21:16:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.279 21:16:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.279 21:16:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:13.279 21:16:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:13.279 21:16:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:13.279 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.279 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:13.279 altname enp24s0f1np1 00:15:13.279 altname ens785f1np1 00:15:13.279 inet 192.168.100.9/24 scope global mlx_0_1 00:15:13.279 valid_lft forever preferred_lft forever 00:15:13.279 21:16:07 -- nvmf/common.sh@411 -- # return 0 00:15:13.279 21:16:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:13.279 21:16:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:13.279 21:16:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:13.279 21:16:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:13.279 21:16:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:13.279 21:16:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.279 21:16:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.279 21:16:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.279 21:16:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.279 21:16:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.279 21:16:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.279 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.279 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.279 21:16:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.279 21:16:07 -- nvmf/common.sh@105 -- # continue 2 00:15:13.279 21:16:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.279 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.279 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.279 21:16:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.279 21:16:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.279 21:16:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@105 -- # continue 2 00:15:13.279 21:16:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.279 21:16:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:13.279 21:16:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.279 21:16:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.279 21:16:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.279 21:16:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.279 21:16:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:13.279 192.168.100.9' 00:15:13.279 21:16:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:13.279 192.168.100.9' 00:15:13.279 21:16:07 -- nvmf/common.sh@446 -- # head -n 1 00:15:13.279 21:16:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:13.279 21:16:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:13.279 192.168.100.9' 00:15:13.279 21:16:07 -- nvmf/common.sh@447 -- # tail -n +2 00:15:13.279 21:16:07 -- nvmf/common.sh@447 -- # head -n 1 00:15:13.279 21:16:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:13.279 21:16:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:13.279 21:16:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:13.279 21:16:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:13.279 21:16:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:13.279 21:16:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:13.279 21:16:07 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:15:13.279 21:16:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:13.279 21:16:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:13.279 21:16:07 -- common/autotest_common.sh@10 -- # set +x 00:15:13.279 21:16:07 -- nvmf/common.sh@470 -- # nvmfpid=1289092 00:15:13.279 21:16:07 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:13.279 21:16:07 -- nvmf/common.sh@471 -- # waitforlisten 1289092 00:15:13.279 21:16:07 -- common/autotest_common.sh@817 -- # '[' -z 1289092 ']' 00:15:13.279 21:16:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:13.279 21:16:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:13.279 21:16:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:13.279 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:13.279 21:16:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:13.279 21:16:07 -- common/autotest_common.sh@10 -- # set +x 00:15:13.539 [2024-04-23 21:16:07.570500] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:15:13.539 [2024-04-23 21:16:07.570540] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:13.539 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.539 [2024-04-23 21:16:07.620232] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:13.539 [2024-04-23 21:16:07.691143] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:13.539 [2024-04-23 21:16:07.691180] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:13.539 [2024-04-23 21:16:07.691185] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:13.539 [2024-04-23 21:16:07.691191] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:13.539 [2024-04-23 21:16:07.691195] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:13.539 [2024-04-23 21:16:07.691311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:13.539 [2024-04-23 21:16:07.691394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:13.539 [2024-04-23 21:16:07.691395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:14.107 21:16:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:14.107 21:16:08 -- common/autotest_common.sh@850 -- # return 0 00:15:14.107 21:16:08 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:14.107 21:16:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:14.107 21:16:08 -- common/autotest_common.sh@10 -- # set +x 00:15:14.367 21:16:08 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:14.367 21:16:08 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:15:14.367 21:16:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:14.367 [2024-04-23 21:16:08.549147] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc63ed0/0xc683c0) succeed. 00:15:14.367 [2024-04-23 21:16:08.558072] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc65470/0xca9a50) succeed. 00:15:14.626 21:16:08 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:14.627 21:16:08 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:14.886 [2024-04-23 21:16:08.978294] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:14.886 21:16:09 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:15.145 21:16:09 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:15:15.145 Malloc0 00:15:15.145 21:16:09 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:15.405 Delay0 00:15:15.405 21:16:09 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:15.405 21:16:09 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:15:15.663 NULL1 00:15:15.664 21:16:09 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:15.923 21:16:09 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=1289640 00:15:15.923 21:16:09 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:15:15.923 21:16:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:15.923 21:16:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:15.923 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.305 Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 21:16:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.305 21:16:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:15:17.305 21:16:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:15:17.305 true 00:15:17.305 21:16:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:17.305 21:16:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 21:16:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.498 21:16:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:15:18.498 21:16:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:15:18.498 true 00:15:18.498 21:16:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:18.498 21:16:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 21:16:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.437 21:16:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:15:19.437 21:16:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:15:19.696 true 00:15:19.696 21:16:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:19.696 21:16:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 21:16:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.631 21:16:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:15:20.631 21:16:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:15:20.890 true 00:15:20.890 21:16:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:20.890 21:16:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 21:16:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.826 21:16:16 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:15:21.826 21:16:16 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:15:22.085 true 00:15:22.085 21:16:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:22.085 21:16:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 21:16:17 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.019 21:16:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:15:23.019 21:16:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:15:23.277 true 00:15:23.277 21:16:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:23.277 21:16:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 21:16:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.210 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:24.467 21:16:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:15:24.467 21:16:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:15:24.467 true 00:15:24.467 21:16:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:24.467 21:16:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 21:16:19 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.410 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.668 21:16:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:15:25.668 21:16:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:15:25.668 true 00:15:25.668 21:16:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:25.668 21:16:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 21:16:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.602 21:16:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:15:26.602 21:16:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:15:26.883 true 00:15:26.883 21:16:21 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:26.883 21:16:21 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 21:16:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.829 21:16:22 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:15:27.829 21:16:22 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:15:28.087 true 00:15:28.087 21:16:22 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:28.087 21:16:22 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 21:16:23 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:29.022 21:16:23 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:15:29.022 21:16:23 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:15:29.280 true 00:15:29.280 21:16:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:29.280 21:16:23 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:30.217 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:30.217 21:16:24 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:30.217 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:30.217 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:30.217 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:30.217 21:16:24 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:15:30.217 21:16:24 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:15:30.476 true 00:15:30.476 21:16:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:30.476 21:16:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 21:16:25 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:31.412 21:16:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:15:31.412 21:16:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:15:31.671 true 00:15:31.671 21:16:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:31.671 21:16:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 21:16:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:32.608 21:16:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:15:32.608 21:16:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:15:32.867 true 00:15:32.867 21:16:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:32.867 21:16:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 21:16:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:33.806 21:16:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:15:33.806 21:16:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:15:34.065 true 00:15:34.065 21:16:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:34.065 21:16:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:34.737 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.737 21:16:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:34.737 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.737 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.996 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.996 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.996 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.996 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:34.996 21:16:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:15:34.996 21:16:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:15:35.254 true 00:15:35.254 21:16:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:35.254 21:16:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 21:16:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.190 21:16:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:15:36.190 21:16:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:15:36.190 true 00:15:36.448 21:16:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:36.448 21:16:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:37.016 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.274 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.274 21:16:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:37.274 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.274 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.274 21:16:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:15:37.274 21:16:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:15:37.533 true 00:15:37.533 21:16:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:37.533 21:16:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 21:16:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.470 21:16:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:15:38.470 21:16:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:15:38.732 true 00:15:38.733 21:16:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:38.733 21:16:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 21:16:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.669 21:16:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:15:39.669 21:16:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:15:39.928 true 00:15:39.928 21:16:34 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:39.928 21:16:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 21:16:34 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.865 21:16:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:15:40.865 21:16:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:15:41.172 true 00:15:41.172 21:16:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:41.172 21:16:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 21:16:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.108 21:16:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:15:42.108 21:16:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:15:42.108 true 00:15:42.366 21:16:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:42.366 21:16:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 21:16:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.303 21:16:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:15:43.303 21:16:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:15:43.303 true 00:15:43.303 21:16:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:43.303 21:16:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:44.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.239 21:16:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:44.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.498 21:16:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:15:44.498 21:16:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:15:44.498 true 00:15:44.498 21:16:38 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:44.498 21:16:38 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.434 21:16:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.693 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.693 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.693 21:16:39 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:15:45.693 21:16:39 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:15:45.693 true 00:15:45.693 21:16:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:45.693 21:16:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:46.627 21:16:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:46.885 21:16:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:15:46.885 21:16:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:15:46.885 true 00:15:46.885 21:16:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:46.885 21:16:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:47.143 21:16:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:47.143 21:16:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:15:47.143 21:16:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:15:47.401 true 00:15:47.401 21:16:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:47.401 21:16:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:47.661 21:16:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:47.661 21:16:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:15:47.661 21:16:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:15:47.920 true 00:15:47.920 21:16:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:47.920 21:16:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:48.179 21:16:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:48.179 21:16:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:15:48.179 21:16:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:15:48.438 true 00:15:48.438 21:16:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:48.438 21:16:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:48.438 21:16:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:48.696 Initializing NVMe Controllers 00:15:48.696 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:15:48.696 Controller IO queue size 128, less than required. 00:15:48.696 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:48.696 Controller IO queue size 128, less than required. 00:15:48.696 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:48.697 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:48.697 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:15:48.697 Initialization complete. Launching workers. 00:15:48.697 ======================================================== 00:15:48.697 Latency(us) 00:15:48.697 Device Information : IOPS MiB/s Average min max 00:15:48.697 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5734.17 2.80 19860.62 833.86 1127030.67 00:15:48.697 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 36545.50 17.84 3502.34 2122.30 268735.49 00:15:48.697 ======================================================== 00:15:48.697 Total : 42279.67 20.64 5720.92 833.86 1127030.67 00:15:48.697 00:15:48.697 21:16:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:15:48.697 21:16:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:15:48.956 true 00:15:48.956 21:16:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 1289640 00:15:48.956 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (1289640) - No such process 00:15:48.956 21:16:43 -- target/ns_hotplug_stress.sh@44 -- # wait 1289640 00:15:48.956 21:16:43 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:15:48.956 21:16:43 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:15:48.956 21:16:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:48.956 21:16:43 -- nvmf/common.sh@117 -- # sync 00:15:48.956 21:16:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:48.956 21:16:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:48.956 21:16:43 -- nvmf/common.sh@120 -- # set +e 00:15:48.956 21:16:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:48.956 21:16:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:48.956 rmmod nvme_rdma 00:15:48.956 rmmod nvme_fabrics 00:15:48.956 21:16:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:48.956 21:16:43 -- nvmf/common.sh@124 -- # set -e 00:15:48.956 21:16:43 -- nvmf/common.sh@125 -- # return 0 00:15:48.956 21:16:43 -- nvmf/common.sh@478 -- # '[' -n 1289092 ']' 00:15:48.956 21:16:43 -- nvmf/common.sh@479 -- # killprocess 1289092 00:15:48.956 21:16:43 -- common/autotest_common.sh@936 -- # '[' -z 1289092 ']' 00:15:48.956 21:16:43 -- common/autotest_common.sh@940 -- # kill -0 1289092 00:15:48.956 21:16:43 -- common/autotest_common.sh@941 -- # uname 00:15:48.956 21:16:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.956 21:16:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1289092 00:15:48.956 21:16:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:48.956 21:16:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:48.956 21:16:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1289092' 00:15:48.956 killing process with pid 1289092 00:15:48.956 21:16:43 -- common/autotest_common.sh@955 -- # kill 1289092 00:15:48.956 21:16:43 -- common/autotest_common.sh@960 -- # wait 1289092 00:15:48.956 [2024-04-23 21:16:43.162113] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:49.215 21:16:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:49.216 21:16:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:49.216 00:15:49.216 real 0m41.306s 00:15:49.216 user 2m34.230s 00:15:49.216 sys 0m7.028s 00:15:49.216 21:16:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:49.216 21:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:49.216 ************************************ 00:15:49.216 END TEST nvmf_ns_hotplug_stress 00:15:49.216 ************************************ 00:15:49.216 21:16:43 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:15:49.216 21:16:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:49.216 21:16:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:49.216 21:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:49.474 ************************************ 00:15:49.474 START TEST nvmf_connect_stress 00:15:49.474 ************************************ 00:15:49.474 21:16:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:15:49.474 * Looking for test storage... 00:15:49.474 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:49.474 21:16:43 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:49.474 21:16:43 -- nvmf/common.sh@7 -- # uname -s 00:15:49.474 21:16:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:49.474 21:16:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:49.474 21:16:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:49.474 21:16:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:49.474 21:16:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:49.474 21:16:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:49.474 21:16:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:49.474 21:16:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:49.475 21:16:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:49.475 21:16:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:49.475 21:16:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:15:49.475 21:16:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:15:49.475 21:16:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:49.475 21:16:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:49.475 21:16:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:49.475 21:16:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:49.475 21:16:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:49.475 21:16:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:49.475 21:16:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:49.475 21:16:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:49.475 21:16:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.475 21:16:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.475 21:16:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.475 21:16:43 -- paths/export.sh@5 -- # export PATH 00:15:49.475 21:16:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.475 21:16:43 -- nvmf/common.sh@47 -- # : 0 00:15:49.475 21:16:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:49.475 21:16:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:49.475 21:16:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:49.475 21:16:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:49.475 21:16:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:49.475 21:16:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:49.475 21:16:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:49.475 21:16:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:49.475 21:16:43 -- target/connect_stress.sh@12 -- # nvmftestinit 00:15:49.475 21:16:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:49.475 21:16:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:49.475 21:16:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:49.475 21:16:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:49.475 21:16:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:49.475 21:16:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.475 21:16:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.475 21:16:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.475 21:16:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:49.475 21:16:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:49.475 21:16:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:49.475 21:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:54.750 21:16:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:54.751 21:16:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:54.751 21:16:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:54.751 21:16:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:54.751 21:16:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:54.751 21:16:48 -- nvmf/common.sh@295 -- # net_devs=() 00:15:54.751 21:16:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@296 -- # e810=() 00:15:54.751 21:16:48 -- nvmf/common.sh@296 -- # local -ga e810 00:15:54.751 21:16:48 -- nvmf/common.sh@297 -- # x722=() 00:15:54.751 21:16:48 -- nvmf/common.sh@297 -- # local -ga x722 00:15:54.751 21:16:48 -- nvmf/common.sh@298 -- # mlx=() 00:15:54.751 21:16:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:54.751 21:16:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:54.751 21:16:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:54.751 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:54.751 21:16:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:54.751 21:16:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:54.751 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:54.751 21:16:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:54.751 21:16:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.751 21:16:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.751 21:16:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:54.751 Found net devices under 0000:18:00.0: mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.751 21:16:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.751 21:16:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:54.751 Found net devices under 0000:18:00.1: mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.751 21:16:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:54.751 21:16:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:54.751 21:16:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:54.751 21:16:48 -- nvmf/common.sh@58 -- # uname 00:15:54.751 21:16:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:54.751 21:16:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:54.751 21:16:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:54.751 21:16:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:54.751 21:16:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:54.751 21:16:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:54.751 21:16:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:54.751 21:16:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:54.751 21:16:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:54.751 21:16:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:54.751 21:16:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:54.751 21:16:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:54.751 21:16:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:54.751 21:16:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@105 -- # continue 2 00:15:54.751 21:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@105 -- # continue 2 00:15:54.751 21:16:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:54.751 21:16:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:54.751 21:16:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:54.751 21:16:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:54.751 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:54.751 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:54.751 altname enp24s0f0np0 00:15:54.751 altname ens785f0np0 00:15:54.751 inet 192.168.100.8/24 scope global mlx_0_0 00:15:54.751 valid_lft forever preferred_lft forever 00:15:54.751 21:16:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:54.751 21:16:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:54.751 21:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:54.751 21:16:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:54.751 21:16:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:54.751 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:54.751 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:54.751 altname enp24s0f1np1 00:15:54.751 altname ens785f1np1 00:15:54.751 inet 192.168.100.9/24 scope global mlx_0_1 00:15:54.751 valid_lft forever preferred_lft forever 00:15:54.751 21:16:48 -- nvmf/common.sh@411 -- # return 0 00:15:54.751 21:16:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:54.751 21:16:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:54.751 21:16:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:54.751 21:16:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:54.751 21:16:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:54.751 21:16:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:54.751 21:16:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:54.751 21:16:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:54.751 21:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@105 -- # continue 2 00:15:54.751 21:16:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:54.751 21:16:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:54.751 21:16:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:54.751 21:16:48 -- nvmf/common.sh@105 -- # continue 2 00:15:54.751 21:16:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:54.751 21:16:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:54.751 21:16:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:54.752 21:16:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:54.752 21:16:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:54.752 21:16:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:54.752 21:16:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:54.752 21:16:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:54.752 192.168.100.9' 00:15:54.752 21:16:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:54.752 192.168.100.9' 00:15:54.752 21:16:48 -- nvmf/common.sh@446 -- # head -n 1 00:15:54.752 21:16:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:54.752 21:16:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:54.752 192.168.100.9' 00:15:54.752 21:16:48 -- nvmf/common.sh@447 -- # tail -n +2 00:15:54.752 21:16:48 -- nvmf/common.sh@447 -- # head -n 1 00:15:54.752 21:16:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:54.752 21:16:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:54.752 21:16:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:54.752 21:16:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:54.752 21:16:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:54.752 21:16:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:54.752 21:16:48 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:15:54.752 21:16:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:54.752 21:16:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:54.752 21:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:54.752 21:16:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:54.752 21:16:48 -- nvmf/common.sh@470 -- # nvmfpid=1298907 00:15:54.752 21:16:48 -- nvmf/common.sh@471 -- # waitforlisten 1298907 00:15:54.752 21:16:48 -- common/autotest_common.sh@817 -- # '[' -z 1298907 ']' 00:15:54.752 21:16:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:54.752 21:16:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:54.752 21:16:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:54.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:54.752 21:16:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:54.752 21:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:54.752 [2024-04-23 21:16:48.767543] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:15:54.752 [2024-04-23 21:16:48.767587] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:54.752 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.752 [2024-04-23 21:16:48.817469] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:54.752 [2024-04-23 21:16:48.887012] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:54.752 [2024-04-23 21:16:48.887050] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:54.752 [2024-04-23 21:16:48.887057] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:54.752 [2024-04-23 21:16:48.887062] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:54.752 [2024-04-23 21:16:48.887067] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:54.752 [2024-04-23 21:16:48.887167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:54.752 [2024-04-23 21:16:48.887254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:54.752 [2024-04-23 21:16:48.887255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.319 21:16:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:55.319 21:16:49 -- common/autotest_common.sh@850 -- # return 0 00:15:55.319 21:16:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:55.319 21:16:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:55.319 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.578 21:16:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:55.578 21:16:49 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:55.578 21:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:55.578 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.578 [2024-04-23 21:16:49.625398] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1063ed0/0x10683c0) succeed. 00:15:55.578 [2024-04-23 21:16:49.634613] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1065470/0x10a9a50) succeed. 00:15:55.578 21:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:55.578 21:16:49 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:55.578 21:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:55.578 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.578 21:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:55.578 21:16:49 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:55.578 21:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:55.578 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.578 [2024-04-23 21:16:49.745051] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:55.578 21:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:55.578 21:16:49 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:55.578 21:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:55.578 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.578 NULL1 00:15:55.578 21:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:55.578 21:16:49 -- target/connect_stress.sh@21 -- # PERF_PID=1299181 00:15:55.578 21:16:49 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:55.578 21:16:49 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:55.578 21:16:49 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:55.578 21:16:49 -- target/connect_stress.sh@27 -- # seq 1 20 00:15:55.578 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.578 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.578 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.578 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.578 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:55.579 21:16:49 -- target/connect_stress.sh@28 -- # cat 00:15:55.579 21:16:49 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:55.579 21:16:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:55.579 21:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:55.579 21:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:56.146 21:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:56.146 21:16:50 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:56.147 21:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:56.147 21:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:56.147 21:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:56.405 21:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:56.405 21:16:50 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:56.405 21:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:56.405 21:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:56.405 21:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:56.664 21:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:56.664 21:16:50 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:56.664 21:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:56.664 21:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:56.664 21:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:56.996 21:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:56.996 21:16:51 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:56.996 21:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:56.996 21:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:56.996 21:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:57.254 21:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.254 21:16:51 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:57.254 21:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:57.254 21:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.254 21:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:57.821 21:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.821 21:16:51 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:57.821 21:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:57.821 21:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.821 21:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:58.079 21:16:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:58.079 21:16:52 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:58.079 21:16:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:58.079 21:16:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:58.079 21:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:58.337 21:16:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:58.337 21:16:52 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:58.337 21:16:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:58.337 21:16:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:58.337 21:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:58.596 21:16:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:58.596 21:16:52 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:58.596 21:16:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:58.596 21:16:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:58.596 21:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:58.855 21:16:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:58.855 21:16:53 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:58.855 21:16:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:58.855 21:16:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:58.855 21:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:59.424 21:16:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:59.424 21:16:53 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:59.424 21:16:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:59.424 21:16:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:59.424 21:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:59.683 21:16:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:59.683 21:16:53 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:59.683 21:16:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:59.683 21:16:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:59.683 21:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:59.943 21:16:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:59.943 21:16:54 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:15:59.943 21:16:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:59.943 21:16:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:59.943 21:16:54 -- common/autotest_common.sh@10 -- # set +x 00:16:00.202 21:16:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:00.202 21:16:54 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:00.202 21:16:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:00.202 21:16:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:00.202 21:16:54 -- common/autotest_common.sh@10 -- # set +x 00:16:00.461 21:16:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:00.461 21:16:54 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:00.461 21:16:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:00.461 21:16:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:00.461 21:16:54 -- common/autotest_common.sh@10 -- # set +x 00:16:01.028 21:16:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:01.028 21:16:55 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:01.028 21:16:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:01.028 21:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:01.029 21:16:55 -- common/autotest_common.sh@10 -- # set +x 00:16:01.288 21:16:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:01.288 21:16:55 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:01.288 21:16:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:01.288 21:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:01.288 21:16:55 -- common/autotest_common.sh@10 -- # set +x 00:16:01.547 21:16:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:01.547 21:16:55 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:01.547 21:16:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:01.547 21:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:01.547 21:16:55 -- common/autotest_common.sh@10 -- # set +x 00:16:01.805 21:16:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:01.805 21:16:55 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:01.805 21:16:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:01.805 21:16:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:01.805 21:16:55 -- common/autotest_common.sh@10 -- # set +x 00:16:02.064 21:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:02.064 21:16:56 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:02.064 21:16:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:02.064 21:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:02.064 21:16:56 -- common/autotest_common.sh@10 -- # set +x 00:16:02.631 21:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:02.631 21:16:56 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:02.631 21:16:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:02.631 21:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:02.631 21:16:56 -- common/autotest_common.sh@10 -- # set +x 00:16:02.890 21:16:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:02.890 21:16:56 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:02.890 21:16:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:02.890 21:16:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:02.890 21:16:56 -- common/autotest_common.sh@10 -- # set +x 00:16:03.149 21:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:03.149 21:16:57 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:03.149 21:16:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:03.149 21:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:03.149 21:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:03.408 21:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:03.408 21:16:57 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:03.408 21:16:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:03.408 21:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:03.408 21:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:03.667 21:16:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:03.667 21:16:57 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:03.667 21:16:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:03.667 21:16:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:03.667 21:16:57 -- common/autotest_common.sh@10 -- # set +x 00:16:04.235 21:16:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:04.235 21:16:58 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:04.235 21:16:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:04.235 21:16:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:04.235 21:16:58 -- common/autotest_common.sh@10 -- # set +x 00:16:04.494 21:16:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:04.494 21:16:58 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:04.494 21:16:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:04.494 21:16:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:04.494 21:16:58 -- common/autotest_common.sh@10 -- # set +x 00:16:04.753 21:16:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:04.753 21:16:58 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:04.753 21:16:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:04.753 21:16:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:04.753 21:16:58 -- common/autotest_common.sh@10 -- # set +x 00:16:05.012 21:16:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.012 21:16:59 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:05.012 21:16:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:05.012 21:16:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.012 21:16:59 -- common/autotest_common.sh@10 -- # set +x 00:16:05.580 21:16:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.580 21:16:59 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:05.580 21:16:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:05.580 21:16:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.580 21:16:59 -- common/autotest_common.sh@10 -- # set +x 00:16:05.838 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:05.838 21:16:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.838 21:16:59 -- target/connect_stress.sh@34 -- # kill -0 1299181 00:16:05.838 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1299181) - No such process 00:16:05.838 21:16:59 -- target/connect_stress.sh@38 -- # wait 1299181 00:16:05.838 21:16:59 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:16:05.838 21:16:59 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:05.838 21:16:59 -- target/connect_stress.sh@43 -- # nvmftestfini 00:16:05.838 21:16:59 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:05.839 21:16:59 -- nvmf/common.sh@117 -- # sync 00:16:05.839 21:16:59 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:05.839 21:16:59 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:05.839 21:16:59 -- nvmf/common.sh@120 -- # set +e 00:16:05.839 21:16:59 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:05.839 21:16:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:05.839 rmmod nvme_rdma 00:16:05.839 rmmod nvme_fabrics 00:16:05.839 21:16:59 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:05.839 21:16:59 -- nvmf/common.sh@124 -- # set -e 00:16:05.839 21:16:59 -- nvmf/common.sh@125 -- # return 0 00:16:05.839 21:16:59 -- nvmf/common.sh@478 -- # '[' -n 1298907 ']' 00:16:05.839 21:16:59 -- nvmf/common.sh@479 -- # killprocess 1298907 00:16:05.839 21:16:59 -- common/autotest_common.sh@936 -- # '[' -z 1298907 ']' 00:16:05.839 21:16:59 -- common/autotest_common.sh@940 -- # kill -0 1298907 00:16:05.839 21:16:59 -- common/autotest_common.sh@941 -- # uname 00:16:05.839 21:16:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:05.839 21:16:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1298907 00:16:05.839 21:16:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:05.839 21:16:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:05.839 21:16:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1298907' 00:16:05.839 killing process with pid 1298907 00:16:05.839 21:16:59 -- common/autotest_common.sh@955 -- # kill 1298907 00:16:05.839 21:16:59 -- common/autotest_common.sh@960 -- # wait 1298907 00:16:05.839 [2024-04-23 21:17:00.036626] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:06.097 21:17:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:06.097 21:17:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:06.097 00:16:06.097 real 0m16.724s 00:16:06.097 user 0m41.342s 00:16:06.097 sys 0m5.595s 00:16:06.097 21:17:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:06.097 21:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:06.097 ************************************ 00:16:06.097 END TEST nvmf_connect_stress 00:16:06.097 ************************************ 00:16:06.097 21:17:00 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:16:06.097 21:17:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:06.097 21:17:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:06.097 21:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:06.356 ************************************ 00:16:06.356 START TEST nvmf_fused_ordering 00:16:06.356 ************************************ 00:16:06.356 21:17:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:16:06.356 * Looking for test storage... 00:16:06.356 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:06.356 21:17:00 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:06.356 21:17:00 -- nvmf/common.sh@7 -- # uname -s 00:16:06.356 21:17:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:06.356 21:17:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:06.356 21:17:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:06.356 21:17:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:06.356 21:17:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:06.356 21:17:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:06.356 21:17:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:06.356 21:17:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:06.356 21:17:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:06.356 21:17:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:06.356 21:17:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:06.356 21:17:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:06.356 21:17:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:06.356 21:17:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:06.356 21:17:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:06.356 21:17:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:06.356 21:17:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:06.356 21:17:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:06.356 21:17:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:06.356 21:17:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:06.357 21:17:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:06.357 21:17:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:06.357 21:17:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:06.357 21:17:00 -- paths/export.sh@5 -- # export PATH 00:16:06.357 21:17:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:06.357 21:17:00 -- nvmf/common.sh@47 -- # : 0 00:16:06.357 21:17:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:06.357 21:17:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:06.357 21:17:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:06.357 21:17:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:06.357 21:17:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:06.357 21:17:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:06.357 21:17:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:06.357 21:17:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:06.357 21:17:00 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:16:06.357 21:17:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:06.357 21:17:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:06.357 21:17:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:06.357 21:17:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:06.357 21:17:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:06.357 21:17:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:06.357 21:17:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:06.357 21:17:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:06.357 21:17:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:06.357 21:17:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:06.357 21:17:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:06.357 21:17:00 -- common/autotest_common.sh@10 -- # set +x 00:16:11.629 21:17:05 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:11.629 21:17:05 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:11.629 21:17:05 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:11.629 21:17:05 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:11.629 21:17:05 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:11.629 21:17:05 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:11.629 21:17:05 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:11.629 21:17:05 -- nvmf/common.sh@295 -- # net_devs=() 00:16:11.629 21:17:05 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:11.629 21:17:05 -- nvmf/common.sh@296 -- # e810=() 00:16:11.629 21:17:05 -- nvmf/common.sh@296 -- # local -ga e810 00:16:11.629 21:17:05 -- nvmf/common.sh@297 -- # x722=() 00:16:11.629 21:17:05 -- nvmf/common.sh@297 -- # local -ga x722 00:16:11.629 21:17:05 -- nvmf/common.sh@298 -- # mlx=() 00:16:11.629 21:17:05 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:11.629 21:17:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:11.629 21:17:05 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:11.629 21:17:05 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:11.629 21:17:05 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:11.629 21:17:05 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:11.629 21:17:05 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:11.629 21:17:05 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:11.629 21:17:05 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:11.629 21:17:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:11.629 21:17:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:11.629 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:11.629 21:17:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:11.629 21:17:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:11.629 21:17:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:11.630 21:17:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:11.630 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:11.630 21:17:05 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:11.630 21:17:05 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:11.630 21:17:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:11.630 21:17:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:11.630 Found net devices under 0000:18:00.0: mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:11.630 21:17:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:11.630 21:17:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:11.630 21:17:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:11.630 Found net devices under 0000:18:00.1: mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:11.630 21:17:05 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:11.630 21:17:05 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:11.630 21:17:05 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:11.630 21:17:05 -- nvmf/common.sh@58 -- # uname 00:16:11.630 21:17:05 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:11.630 21:17:05 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:11.630 21:17:05 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:11.630 21:17:05 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:11.630 21:17:05 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:11.630 21:17:05 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:11.630 21:17:05 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:11.630 21:17:05 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:11.630 21:17:05 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:11.630 21:17:05 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:11.630 21:17:05 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:11.630 21:17:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:11.630 21:17:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:11.630 21:17:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:11.630 21:17:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:11.630 21:17:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@105 -- # continue 2 00:16:11.630 21:17:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@105 -- # continue 2 00:16:11.630 21:17:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:11.630 21:17:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:11.630 21:17:05 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:11.630 21:17:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:11.630 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:11.630 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:11.630 altname enp24s0f0np0 00:16:11.630 altname ens785f0np0 00:16:11.630 inet 192.168.100.8/24 scope global mlx_0_0 00:16:11.630 valid_lft forever preferred_lft forever 00:16:11.630 21:17:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:11.630 21:17:05 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:11.630 21:17:05 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:11.630 21:17:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:11.630 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:11.630 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:11.630 altname enp24s0f1np1 00:16:11.630 altname ens785f1np1 00:16:11.630 inet 192.168.100.9/24 scope global mlx_0_1 00:16:11.630 valid_lft forever preferred_lft forever 00:16:11.630 21:17:05 -- nvmf/common.sh@411 -- # return 0 00:16:11.630 21:17:05 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:11.630 21:17:05 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:11.630 21:17:05 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:11.630 21:17:05 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:11.630 21:17:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:11.630 21:17:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:11.630 21:17:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:11.630 21:17:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:11.630 21:17:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:11.630 21:17:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@105 -- # continue 2 00:16:11.630 21:17:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:11.630 21:17:05 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:11.630 21:17:05 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@105 -- # continue 2 00:16:11.630 21:17:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:11.630 21:17:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:11.630 21:17:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:11.630 21:17:05 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:11.630 21:17:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:11.630 21:17:05 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:11.630 192.168.100.9' 00:16:11.630 21:17:05 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:11.630 192.168.100.9' 00:16:11.630 21:17:05 -- nvmf/common.sh@446 -- # head -n 1 00:16:11.630 21:17:05 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:11.630 21:17:05 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:11.630 192.168.100.9' 00:16:11.630 21:17:05 -- nvmf/common.sh@447 -- # tail -n +2 00:16:11.630 21:17:05 -- nvmf/common.sh@447 -- # head -n 1 00:16:11.630 21:17:05 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:11.630 21:17:05 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:11.630 21:17:05 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:11.630 21:17:05 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:11.630 21:17:05 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:11.630 21:17:05 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:11.630 21:17:05 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:16:11.630 21:17:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:11.630 21:17:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:11.630 21:17:05 -- common/autotest_common.sh@10 -- # set +x 00:16:11.630 21:17:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:11.630 21:17:05 -- nvmf/common.sh@470 -- # nvmfpid=1304363 00:16:11.630 21:17:05 -- nvmf/common.sh@471 -- # waitforlisten 1304363 00:16:11.630 21:17:05 -- common/autotest_common.sh@817 -- # '[' -z 1304363 ']' 00:16:11.630 21:17:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:11.630 21:17:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:11.630 21:17:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:11.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:11.630 21:17:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:11.631 21:17:05 -- common/autotest_common.sh@10 -- # set +x 00:16:11.631 [2024-04-23 21:17:05.505265] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:16:11.631 [2024-04-23 21:17:05.505323] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:11.631 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.631 [2024-04-23 21:17:05.553246] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:11.631 [2024-04-23 21:17:05.621577] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:11.631 [2024-04-23 21:17:05.621618] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:11.631 [2024-04-23 21:17:05.621623] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:11.631 [2024-04-23 21:17:05.621629] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:11.631 [2024-04-23 21:17:05.621633] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:11.631 [2024-04-23 21:17:05.621648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:12.198 21:17:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:12.198 21:17:06 -- common/autotest_common.sh@850 -- # return 0 00:16:12.198 21:17:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:12.198 21:17:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 21:17:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:12.198 21:17:06 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 [2024-04-23 21:17:06.355513] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x603820/0x607d10) succeed. 00:16:12.198 [2024-04-23 21:17:06.363283] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x604d20/0x6493a0) succeed. 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 [2024-04-23 21:17:06.421226] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 NULL1 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:16:12.198 21:17:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:12.198 21:17:06 -- common/autotest_common.sh@10 -- # set +x 00:16:12.198 21:17:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:12.198 21:17:06 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:16:12.457 [2024-04-23 21:17:06.475442] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:16:12.457 [2024-04-23 21:17:06.475484] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1304530 ] 00:16:12.457 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.457 Attached to nqn.2016-06.io.spdk:cnode1 00:16:12.457 Namespace ID: 1 size: 1GB 00:16:12.457 fused_ordering(0) 00:16:12.457 fused_ordering(1) 00:16:12.457 fused_ordering(2) 00:16:12.457 fused_ordering(3) 00:16:12.457 fused_ordering(4) 00:16:12.457 fused_ordering(5) 00:16:12.457 fused_ordering(6) 00:16:12.457 fused_ordering(7) 00:16:12.457 fused_ordering(8) 00:16:12.457 fused_ordering(9) 00:16:12.457 fused_ordering(10) 00:16:12.457 fused_ordering(11) 00:16:12.457 fused_ordering(12) 00:16:12.457 fused_ordering(13) 00:16:12.457 fused_ordering(14) 00:16:12.457 fused_ordering(15) 00:16:12.457 fused_ordering(16) 00:16:12.457 fused_ordering(17) 00:16:12.457 fused_ordering(18) 00:16:12.457 fused_ordering(19) 00:16:12.457 fused_ordering(20) 00:16:12.457 fused_ordering(21) 00:16:12.457 fused_ordering(22) 00:16:12.457 fused_ordering(23) 00:16:12.457 fused_ordering(24) 00:16:12.457 fused_ordering(25) 00:16:12.457 fused_ordering(26) 00:16:12.457 fused_ordering(27) 00:16:12.457 fused_ordering(28) 00:16:12.457 fused_ordering(29) 00:16:12.457 fused_ordering(30) 00:16:12.457 fused_ordering(31) 00:16:12.457 fused_ordering(32) 00:16:12.457 fused_ordering(33) 00:16:12.457 fused_ordering(34) 00:16:12.457 fused_ordering(35) 00:16:12.457 fused_ordering(36) 00:16:12.457 fused_ordering(37) 00:16:12.457 fused_ordering(38) 00:16:12.457 fused_ordering(39) 00:16:12.457 fused_ordering(40) 00:16:12.457 fused_ordering(41) 00:16:12.457 fused_ordering(42) 00:16:12.457 fused_ordering(43) 00:16:12.457 fused_ordering(44) 00:16:12.457 fused_ordering(45) 00:16:12.457 fused_ordering(46) 00:16:12.457 fused_ordering(47) 00:16:12.457 fused_ordering(48) 00:16:12.457 fused_ordering(49) 00:16:12.457 fused_ordering(50) 00:16:12.457 fused_ordering(51) 00:16:12.457 fused_ordering(52) 00:16:12.457 fused_ordering(53) 00:16:12.457 fused_ordering(54) 00:16:12.457 fused_ordering(55) 00:16:12.457 fused_ordering(56) 00:16:12.457 fused_ordering(57) 00:16:12.457 fused_ordering(58) 00:16:12.457 fused_ordering(59) 00:16:12.457 fused_ordering(60) 00:16:12.457 fused_ordering(61) 00:16:12.457 fused_ordering(62) 00:16:12.457 fused_ordering(63) 00:16:12.457 fused_ordering(64) 00:16:12.457 fused_ordering(65) 00:16:12.457 fused_ordering(66) 00:16:12.457 fused_ordering(67) 00:16:12.457 fused_ordering(68) 00:16:12.457 fused_ordering(69) 00:16:12.457 fused_ordering(70) 00:16:12.457 fused_ordering(71) 00:16:12.457 fused_ordering(72) 00:16:12.457 fused_ordering(73) 00:16:12.457 fused_ordering(74) 00:16:12.457 fused_ordering(75) 00:16:12.457 fused_ordering(76) 00:16:12.457 fused_ordering(77) 00:16:12.457 fused_ordering(78) 00:16:12.457 fused_ordering(79) 00:16:12.457 fused_ordering(80) 00:16:12.457 fused_ordering(81) 00:16:12.457 fused_ordering(82) 00:16:12.457 fused_ordering(83) 00:16:12.457 fused_ordering(84) 00:16:12.457 fused_ordering(85) 00:16:12.457 fused_ordering(86) 00:16:12.457 fused_ordering(87) 00:16:12.457 fused_ordering(88) 00:16:12.457 fused_ordering(89) 00:16:12.457 fused_ordering(90) 00:16:12.457 fused_ordering(91) 00:16:12.457 fused_ordering(92) 00:16:12.457 fused_ordering(93) 00:16:12.457 fused_ordering(94) 00:16:12.457 fused_ordering(95) 00:16:12.457 fused_ordering(96) 00:16:12.458 fused_ordering(97) 00:16:12.458 fused_ordering(98) 00:16:12.458 fused_ordering(99) 00:16:12.458 fused_ordering(100) 00:16:12.458 fused_ordering(101) 00:16:12.458 fused_ordering(102) 00:16:12.458 fused_ordering(103) 00:16:12.458 fused_ordering(104) 00:16:12.458 fused_ordering(105) 00:16:12.458 fused_ordering(106) 00:16:12.458 fused_ordering(107) 00:16:12.458 fused_ordering(108) 00:16:12.458 fused_ordering(109) 00:16:12.458 fused_ordering(110) 00:16:12.458 fused_ordering(111) 00:16:12.458 fused_ordering(112) 00:16:12.458 fused_ordering(113) 00:16:12.458 fused_ordering(114) 00:16:12.458 fused_ordering(115) 00:16:12.458 fused_ordering(116) 00:16:12.458 fused_ordering(117) 00:16:12.458 fused_ordering(118) 00:16:12.458 fused_ordering(119) 00:16:12.458 fused_ordering(120) 00:16:12.458 fused_ordering(121) 00:16:12.458 fused_ordering(122) 00:16:12.458 fused_ordering(123) 00:16:12.458 fused_ordering(124) 00:16:12.458 fused_ordering(125) 00:16:12.458 fused_ordering(126) 00:16:12.458 fused_ordering(127) 00:16:12.458 fused_ordering(128) 00:16:12.458 fused_ordering(129) 00:16:12.458 fused_ordering(130) 00:16:12.458 fused_ordering(131) 00:16:12.458 fused_ordering(132) 00:16:12.458 fused_ordering(133) 00:16:12.458 fused_ordering(134) 00:16:12.458 fused_ordering(135) 00:16:12.458 fused_ordering(136) 00:16:12.458 fused_ordering(137) 00:16:12.458 fused_ordering(138) 00:16:12.458 fused_ordering(139) 00:16:12.458 fused_ordering(140) 00:16:12.458 fused_ordering(141) 00:16:12.458 fused_ordering(142) 00:16:12.458 fused_ordering(143) 00:16:12.458 fused_ordering(144) 00:16:12.458 fused_ordering(145) 00:16:12.458 fused_ordering(146) 00:16:12.458 fused_ordering(147) 00:16:12.458 fused_ordering(148) 00:16:12.458 fused_ordering(149) 00:16:12.458 fused_ordering(150) 00:16:12.458 fused_ordering(151) 00:16:12.458 fused_ordering(152) 00:16:12.458 fused_ordering(153) 00:16:12.458 fused_ordering(154) 00:16:12.458 fused_ordering(155) 00:16:12.458 fused_ordering(156) 00:16:12.458 fused_ordering(157) 00:16:12.458 fused_ordering(158) 00:16:12.458 fused_ordering(159) 00:16:12.458 fused_ordering(160) 00:16:12.458 fused_ordering(161) 00:16:12.458 fused_ordering(162) 00:16:12.458 fused_ordering(163) 00:16:12.458 fused_ordering(164) 00:16:12.458 fused_ordering(165) 00:16:12.458 fused_ordering(166) 00:16:12.458 fused_ordering(167) 00:16:12.458 fused_ordering(168) 00:16:12.458 fused_ordering(169) 00:16:12.458 fused_ordering(170) 00:16:12.458 fused_ordering(171) 00:16:12.458 fused_ordering(172) 00:16:12.458 fused_ordering(173) 00:16:12.458 fused_ordering(174) 00:16:12.458 fused_ordering(175) 00:16:12.458 fused_ordering(176) 00:16:12.458 fused_ordering(177) 00:16:12.458 fused_ordering(178) 00:16:12.458 fused_ordering(179) 00:16:12.458 fused_ordering(180) 00:16:12.458 fused_ordering(181) 00:16:12.458 fused_ordering(182) 00:16:12.458 fused_ordering(183) 00:16:12.458 fused_ordering(184) 00:16:12.458 fused_ordering(185) 00:16:12.458 fused_ordering(186) 00:16:12.458 fused_ordering(187) 00:16:12.458 fused_ordering(188) 00:16:12.458 fused_ordering(189) 00:16:12.458 fused_ordering(190) 00:16:12.458 fused_ordering(191) 00:16:12.458 fused_ordering(192) 00:16:12.458 fused_ordering(193) 00:16:12.458 fused_ordering(194) 00:16:12.458 fused_ordering(195) 00:16:12.458 fused_ordering(196) 00:16:12.458 fused_ordering(197) 00:16:12.458 fused_ordering(198) 00:16:12.458 fused_ordering(199) 00:16:12.458 fused_ordering(200) 00:16:12.458 fused_ordering(201) 00:16:12.458 fused_ordering(202) 00:16:12.458 fused_ordering(203) 00:16:12.458 fused_ordering(204) 00:16:12.458 fused_ordering(205) 00:16:12.458 fused_ordering(206) 00:16:12.458 fused_ordering(207) 00:16:12.458 fused_ordering(208) 00:16:12.458 fused_ordering(209) 00:16:12.458 fused_ordering(210) 00:16:12.458 fused_ordering(211) 00:16:12.458 fused_ordering(212) 00:16:12.458 fused_ordering(213) 00:16:12.458 fused_ordering(214) 00:16:12.458 fused_ordering(215) 00:16:12.458 fused_ordering(216) 00:16:12.458 fused_ordering(217) 00:16:12.458 fused_ordering(218) 00:16:12.458 fused_ordering(219) 00:16:12.458 fused_ordering(220) 00:16:12.458 fused_ordering(221) 00:16:12.458 fused_ordering(222) 00:16:12.458 fused_ordering(223) 00:16:12.458 fused_ordering(224) 00:16:12.458 fused_ordering(225) 00:16:12.458 fused_ordering(226) 00:16:12.458 fused_ordering(227) 00:16:12.458 fused_ordering(228) 00:16:12.458 fused_ordering(229) 00:16:12.458 fused_ordering(230) 00:16:12.458 fused_ordering(231) 00:16:12.458 fused_ordering(232) 00:16:12.458 fused_ordering(233) 00:16:12.458 fused_ordering(234) 00:16:12.458 fused_ordering(235) 00:16:12.458 fused_ordering(236) 00:16:12.458 fused_ordering(237) 00:16:12.458 fused_ordering(238) 00:16:12.458 fused_ordering(239) 00:16:12.458 fused_ordering(240) 00:16:12.458 fused_ordering(241) 00:16:12.458 fused_ordering(242) 00:16:12.458 fused_ordering(243) 00:16:12.458 fused_ordering(244) 00:16:12.458 fused_ordering(245) 00:16:12.458 fused_ordering(246) 00:16:12.458 fused_ordering(247) 00:16:12.458 fused_ordering(248) 00:16:12.458 fused_ordering(249) 00:16:12.458 fused_ordering(250) 00:16:12.458 fused_ordering(251) 00:16:12.458 fused_ordering(252) 00:16:12.458 fused_ordering(253) 00:16:12.458 fused_ordering(254) 00:16:12.458 fused_ordering(255) 00:16:12.458 fused_ordering(256) 00:16:12.458 fused_ordering(257) 00:16:12.458 fused_ordering(258) 00:16:12.458 fused_ordering(259) 00:16:12.458 fused_ordering(260) 00:16:12.458 fused_ordering(261) 00:16:12.458 fused_ordering(262) 00:16:12.458 fused_ordering(263) 00:16:12.458 fused_ordering(264) 00:16:12.458 fused_ordering(265) 00:16:12.458 fused_ordering(266) 00:16:12.458 fused_ordering(267) 00:16:12.458 fused_ordering(268) 00:16:12.458 fused_ordering(269) 00:16:12.458 fused_ordering(270) 00:16:12.458 fused_ordering(271) 00:16:12.458 fused_ordering(272) 00:16:12.458 fused_ordering(273) 00:16:12.458 fused_ordering(274) 00:16:12.458 fused_ordering(275) 00:16:12.458 fused_ordering(276) 00:16:12.458 fused_ordering(277) 00:16:12.458 fused_ordering(278) 00:16:12.458 fused_ordering(279) 00:16:12.458 fused_ordering(280) 00:16:12.458 fused_ordering(281) 00:16:12.458 fused_ordering(282) 00:16:12.458 fused_ordering(283) 00:16:12.458 fused_ordering(284) 00:16:12.458 fused_ordering(285) 00:16:12.458 fused_ordering(286) 00:16:12.458 fused_ordering(287) 00:16:12.458 fused_ordering(288) 00:16:12.458 fused_ordering(289) 00:16:12.458 fused_ordering(290) 00:16:12.458 fused_ordering(291) 00:16:12.458 fused_ordering(292) 00:16:12.458 fused_ordering(293) 00:16:12.458 fused_ordering(294) 00:16:12.458 fused_ordering(295) 00:16:12.458 fused_ordering(296) 00:16:12.458 fused_ordering(297) 00:16:12.458 fused_ordering(298) 00:16:12.458 fused_ordering(299) 00:16:12.458 fused_ordering(300) 00:16:12.458 fused_ordering(301) 00:16:12.458 fused_ordering(302) 00:16:12.458 fused_ordering(303) 00:16:12.458 fused_ordering(304) 00:16:12.458 fused_ordering(305) 00:16:12.458 fused_ordering(306) 00:16:12.458 fused_ordering(307) 00:16:12.458 fused_ordering(308) 00:16:12.458 fused_ordering(309) 00:16:12.458 fused_ordering(310) 00:16:12.458 fused_ordering(311) 00:16:12.458 fused_ordering(312) 00:16:12.458 fused_ordering(313) 00:16:12.458 fused_ordering(314) 00:16:12.458 fused_ordering(315) 00:16:12.458 fused_ordering(316) 00:16:12.458 fused_ordering(317) 00:16:12.458 fused_ordering(318) 00:16:12.458 fused_ordering(319) 00:16:12.458 fused_ordering(320) 00:16:12.458 fused_ordering(321) 00:16:12.458 fused_ordering(322) 00:16:12.458 fused_ordering(323) 00:16:12.458 fused_ordering(324) 00:16:12.458 fused_ordering(325) 00:16:12.458 fused_ordering(326) 00:16:12.458 fused_ordering(327) 00:16:12.458 fused_ordering(328) 00:16:12.458 fused_ordering(329) 00:16:12.458 fused_ordering(330) 00:16:12.458 fused_ordering(331) 00:16:12.458 fused_ordering(332) 00:16:12.458 fused_ordering(333) 00:16:12.458 fused_ordering(334) 00:16:12.458 fused_ordering(335) 00:16:12.458 fused_ordering(336) 00:16:12.458 fused_ordering(337) 00:16:12.458 fused_ordering(338) 00:16:12.458 fused_ordering(339) 00:16:12.458 fused_ordering(340) 00:16:12.458 fused_ordering(341) 00:16:12.458 fused_ordering(342) 00:16:12.458 fused_ordering(343) 00:16:12.458 fused_ordering(344) 00:16:12.458 fused_ordering(345) 00:16:12.458 fused_ordering(346) 00:16:12.458 fused_ordering(347) 00:16:12.459 fused_ordering(348) 00:16:12.459 fused_ordering(349) 00:16:12.459 fused_ordering(350) 00:16:12.459 fused_ordering(351) 00:16:12.459 fused_ordering(352) 00:16:12.459 fused_ordering(353) 00:16:12.459 fused_ordering(354) 00:16:12.459 fused_ordering(355) 00:16:12.459 fused_ordering(356) 00:16:12.459 fused_ordering(357) 00:16:12.459 fused_ordering(358) 00:16:12.459 fused_ordering(359) 00:16:12.459 fused_ordering(360) 00:16:12.459 fused_ordering(361) 00:16:12.459 fused_ordering(362) 00:16:12.459 fused_ordering(363) 00:16:12.459 fused_ordering(364) 00:16:12.459 fused_ordering(365) 00:16:12.459 fused_ordering(366) 00:16:12.459 fused_ordering(367) 00:16:12.459 fused_ordering(368) 00:16:12.459 fused_ordering(369) 00:16:12.459 fused_ordering(370) 00:16:12.459 fused_ordering(371) 00:16:12.459 fused_ordering(372) 00:16:12.459 fused_ordering(373) 00:16:12.459 fused_ordering(374) 00:16:12.459 fused_ordering(375) 00:16:12.459 fused_ordering(376) 00:16:12.459 fused_ordering(377) 00:16:12.459 fused_ordering(378) 00:16:12.459 fused_ordering(379) 00:16:12.459 fused_ordering(380) 00:16:12.459 fused_ordering(381) 00:16:12.459 fused_ordering(382) 00:16:12.459 fused_ordering(383) 00:16:12.459 fused_ordering(384) 00:16:12.459 fused_ordering(385) 00:16:12.459 fused_ordering(386) 00:16:12.459 fused_ordering(387) 00:16:12.459 fused_ordering(388) 00:16:12.459 fused_ordering(389) 00:16:12.459 fused_ordering(390) 00:16:12.459 fused_ordering(391) 00:16:12.459 fused_ordering(392) 00:16:12.459 fused_ordering(393) 00:16:12.459 fused_ordering(394) 00:16:12.459 fused_ordering(395) 00:16:12.459 fused_ordering(396) 00:16:12.459 fused_ordering(397) 00:16:12.459 fused_ordering(398) 00:16:12.459 fused_ordering(399) 00:16:12.459 fused_ordering(400) 00:16:12.459 fused_ordering(401) 00:16:12.459 fused_ordering(402) 00:16:12.459 fused_ordering(403) 00:16:12.459 fused_ordering(404) 00:16:12.459 fused_ordering(405) 00:16:12.459 fused_ordering(406) 00:16:12.459 fused_ordering(407) 00:16:12.459 fused_ordering(408) 00:16:12.459 fused_ordering(409) 00:16:12.459 fused_ordering(410) 00:16:12.755 fused_ordering(411) 00:16:12.755 fused_ordering(412) 00:16:12.755 fused_ordering(413) 00:16:12.755 fused_ordering(414) 00:16:12.755 fused_ordering(415) 00:16:12.755 fused_ordering(416) 00:16:12.755 fused_ordering(417) 00:16:12.755 fused_ordering(418) 00:16:12.755 fused_ordering(419) 00:16:12.755 fused_ordering(420) 00:16:12.755 fused_ordering(421) 00:16:12.755 fused_ordering(422) 00:16:12.755 fused_ordering(423) 00:16:12.755 fused_ordering(424) 00:16:12.755 fused_ordering(425) 00:16:12.755 fused_ordering(426) 00:16:12.755 fused_ordering(427) 00:16:12.755 fused_ordering(428) 00:16:12.755 fused_ordering(429) 00:16:12.755 fused_ordering(430) 00:16:12.755 fused_ordering(431) 00:16:12.755 fused_ordering(432) 00:16:12.755 fused_ordering(433) 00:16:12.755 fused_ordering(434) 00:16:12.755 fused_ordering(435) 00:16:12.755 fused_ordering(436) 00:16:12.755 fused_ordering(437) 00:16:12.755 fused_ordering(438) 00:16:12.755 fused_ordering(439) 00:16:12.755 fused_ordering(440) 00:16:12.755 fused_ordering(441) 00:16:12.755 fused_ordering(442) 00:16:12.755 fused_ordering(443) 00:16:12.755 fused_ordering(444) 00:16:12.755 fused_ordering(445) 00:16:12.755 fused_ordering(446) 00:16:12.755 fused_ordering(447) 00:16:12.755 fused_ordering(448) 00:16:12.755 fused_ordering(449) 00:16:12.755 fused_ordering(450) 00:16:12.755 fused_ordering(451) 00:16:12.755 fused_ordering(452) 00:16:12.755 fused_ordering(453) 00:16:12.755 fused_ordering(454) 00:16:12.755 fused_ordering(455) 00:16:12.755 fused_ordering(456) 00:16:12.755 fused_ordering(457) 00:16:12.755 fused_ordering(458) 00:16:12.755 fused_ordering(459) 00:16:12.755 fused_ordering(460) 00:16:12.755 fused_ordering(461) 00:16:12.755 fused_ordering(462) 00:16:12.755 fused_ordering(463) 00:16:12.755 fused_ordering(464) 00:16:12.755 fused_ordering(465) 00:16:12.755 fused_ordering(466) 00:16:12.755 fused_ordering(467) 00:16:12.755 fused_ordering(468) 00:16:12.755 fused_ordering(469) 00:16:12.755 fused_ordering(470) 00:16:12.755 fused_ordering(471) 00:16:12.755 fused_ordering(472) 00:16:12.755 fused_ordering(473) 00:16:12.755 fused_ordering(474) 00:16:12.755 fused_ordering(475) 00:16:12.755 fused_ordering(476) 00:16:12.755 fused_ordering(477) 00:16:12.755 fused_ordering(478) 00:16:12.755 fused_ordering(479) 00:16:12.755 fused_ordering(480) 00:16:12.755 fused_ordering(481) 00:16:12.755 fused_ordering(482) 00:16:12.755 fused_ordering(483) 00:16:12.755 fused_ordering(484) 00:16:12.755 fused_ordering(485) 00:16:12.755 fused_ordering(486) 00:16:12.755 fused_ordering(487) 00:16:12.755 fused_ordering(488) 00:16:12.755 fused_ordering(489) 00:16:12.755 fused_ordering(490) 00:16:12.755 fused_ordering(491) 00:16:12.755 fused_ordering(492) 00:16:12.755 fused_ordering(493) 00:16:12.755 fused_ordering(494) 00:16:12.755 fused_ordering(495) 00:16:12.755 fused_ordering(496) 00:16:12.755 fused_ordering(497) 00:16:12.755 fused_ordering(498) 00:16:12.755 fused_ordering(499) 00:16:12.755 fused_ordering(500) 00:16:12.755 fused_ordering(501) 00:16:12.755 fused_ordering(502) 00:16:12.755 fused_ordering(503) 00:16:12.755 fused_ordering(504) 00:16:12.755 fused_ordering(505) 00:16:12.755 fused_ordering(506) 00:16:12.755 fused_ordering(507) 00:16:12.755 fused_ordering(508) 00:16:12.755 fused_ordering(509) 00:16:12.755 fused_ordering(510) 00:16:12.755 fused_ordering(511) 00:16:12.755 fused_ordering(512) 00:16:12.755 fused_ordering(513) 00:16:12.755 fused_ordering(514) 00:16:12.755 fused_ordering(515) 00:16:12.755 fused_ordering(516) 00:16:12.755 fused_ordering(517) 00:16:12.755 fused_ordering(518) 00:16:12.755 fused_ordering(519) 00:16:12.755 fused_ordering(520) 00:16:12.755 fused_ordering(521) 00:16:12.755 fused_ordering(522) 00:16:12.755 fused_ordering(523) 00:16:12.755 fused_ordering(524) 00:16:12.755 fused_ordering(525) 00:16:12.755 fused_ordering(526) 00:16:12.755 fused_ordering(527) 00:16:12.755 fused_ordering(528) 00:16:12.755 fused_ordering(529) 00:16:12.755 fused_ordering(530) 00:16:12.755 fused_ordering(531) 00:16:12.755 fused_ordering(532) 00:16:12.755 fused_ordering(533) 00:16:12.755 fused_ordering(534) 00:16:12.755 fused_ordering(535) 00:16:12.755 fused_ordering(536) 00:16:12.755 fused_ordering(537) 00:16:12.755 fused_ordering(538) 00:16:12.755 fused_ordering(539) 00:16:12.755 fused_ordering(540) 00:16:12.755 fused_ordering(541) 00:16:12.755 fused_ordering(542) 00:16:12.755 fused_ordering(543) 00:16:12.755 fused_ordering(544) 00:16:12.755 fused_ordering(545) 00:16:12.755 fused_ordering(546) 00:16:12.755 fused_ordering(547) 00:16:12.755 fused_ordering(548) 00:16:12.755 fused_ordering(549) 00:16:12.755 fused_ordering(550) 00:16:12.755 fused_ordering(551) 00:16:12.755 fused_ordering(552) 00:16:12.755 fused_ordering(553) 00:16:12.755 fused_ordering(554) 00:16:12.755 fused_ordering(555) 00:16:12.755 fused_ordering(556) 00:16:12.755 fused_ordering(557) 00:16:12.755 fused_ordering(558) 00:16:12.755 fused_ordering(559) 00:16:12.755 fused_ordering(560) 00:16:12.755 fused_ordering(561) 00:16:12.755 fused_ordering(562) 00:16:12.755 fused_ordering(563) 00:16:12.755 fused_ordering(564) 00:16:12.755 fused_ordering(565) 00:16:12.755 fused_ordering(566) 00:16:12.755 fused_ordering(567) 00:16:12.755 fused_ordering(568) 00:16:12.755 fused_ordering(569) 00:16:12.755 fused_ordering(570) 00:16:12.755 fused_ordering(571) 00:16:12.755 fused_ordering(572) 00:16:12.755 fused_ordering(573) 00:16:12.755 fused_ordering(574) 00:16:12.755 fused_ordering(575) 00:16:12.755 fused_ordering(576) 00:16:12.755 fused_ordering(577) 00:16:12.755 fused_ordering(578) 00:16:12.755 fused_ordering(579) 00:16:12.755 fused_ordering(580) 00:16:12.755 fused_ordering(581) 00:16:12.755 fused_ordering(582) 00:16:12.755 fused_ordering(583) 00:16:12.755 fused_ordering(584) 00:16:12.755 fused_ordering(585) 00:16:12.755 fused_ordering(586) 00:16:12.755 fused_ordering(587) 00:16:12.755 fused_ordering(588) 00:16:12.755 fused_ordering(589) 00:16:12.755 fused_ordering(590) 00:16:12.755 fused_ordering(591) 00:16:12.755 fused_ordering(592) 00:16:12.755 fused_ordering(593) 00:16:12.755 fused_ordering(594) 00:16:12.755 fused_ordering(595) 00:16:12.755 fused_ordering(596) 00:16:12.755 fused_ordering(597) 00:16:12.755 fused_ordering(598) 00:16:12.755 fused_ordering(599) 00:16:12.755 fused_ordering(600) 00:16:12.755 fused_ordering(601) 00:16:12.755 fused_ordering(602) 00:16:12.755 fused_ordering(603) 00:16:12.755 fused_ordering(604) 00:16:12.755 fused_ordering(605) 00:16:12.755 fused_ordering(606) 00:16:12.755 fused_ordering(607) 00:16:12.755 fused_ordering(608) 00:16:12.755 fused_ordering(609) 00:16:12.755 fused_ordering(610) 00:16:12.755 fused_ordering(611) 00:16:12.755 fused_ordering(612) 00:16:12.755 fused_ordering(613) 00:16:12.755 fused_ordering(614) 00:16:12.755 fused_ordering(615) 00:16:12.755 fused_ordering(616) 00:16:12.755 fused_ordering(617) 00:16:12.755 fused_ordering(618) 00:16:12.755 fused_ordering(619) 00:16:12.755 fused_ordering(620) 00:16:12.755 fused_ordering(621) 00:16:12.755 fused_ordering(622) 00:16:12.755 fused_ordering(623) 00:16:12.755 fused_ordering(624) 00:16:12.755 fused_ordering(625) 00:16:12.755 fused_ordering(626) 00:16:12.755 fused_ordering(627) 00:16:12.755 fused_ordering(628) 00:16:12.755 fused_ordering(629) 00:16:12.755 fused_ordering(630) 00:16:12.755 fused_ordering(631) 00:16:12.755 fused_ordering(632) 00:16:12.755 fused_ordering(633) 00:16:12.755 fused_ordering(634) 00:16:12.755 fused_ordering(635) 00:16:12.755 fused_ordering(636) 00:16:12.755 fused_ordering(637) 00:16:12.755 fused_ordering(638) 00:16:12.755 fused_ordering(639) 00:16:12.755 fused_ordering(640) 00:16:12.755 fused_ordering(641) 00:16:12.755 fused_ordering(642) 00:16:12.755 fused_ordering(643) 00:16:12.755 fused_ordering(644) 00:16:12.755 fused_ordering(645) 00:16:12.756 fused_ordering(646) 00:16:12.756 fused_ordering(647) 00:16:12.756 fused_ordering(648) 00:16:12.756 fused_ordering(649) 00:16:12.756 fused_ordering(650) 00:16:12.756 fused_ordering(651) 00:16:12.756 fused_ordering(652) 00:16:12.756 fused_ordering(653) 00:16:12.756 fused_ordering(654) 00:16:12.756 fused_ordering(655) 00:16:12.756 fused_ordering(656) 00:16:12.756 fused_ordering(657) 00:16:12.756 fused_ordering(658) 00:16:12.756 fused_ordering(659) 00:16:12.756 fused_ordering(660) 00:16:12.756 fused_ordering(661) 00:16:12.756 fused_ordering(662) 00:16:12.756 fused_ordering(663) 00:16:12.756 fused_ordering(664) 00:16:12.756 fused_ordering(665) 00:16:12.756 fused_ordering(666) 00:16:12.756 fused_ordering(667) 00:16:12.756 fused_ordering(668) 00:16:12.756 fused_ordering(669) 00:16:12.756 fused_ordering(670) 00:16:12.756 fused_ordering(671) 00:16:12.756 fused_ordering(672) 00:16:12.756 fused_ordering(673) 00:16:12.756 fused_ordering(674) 00:16:12.756 fused_ordering(675) 00:16:12.756 fused_ordering(676) 00:16:12.756 fused_ordering(677) 00:16:12.756 fused_ordering(678) 00:16:12.756 fused_ordering(679) 00:16:12.756 fused_ordering(680) 00:16:12.756 fused_ordering(681) 00:16:12.756 fused_ordering(682) 00:16:12.756 fused_ordering(683) 00:16:12.756 fused_ordering(684) 00:16:12.756 fused_ordering(685) 00:16:12.756 fused_ordering(686) 00:16:12.756 fused_ordering(687) 00:16:12.756 fused_ordering(688) 00:16:12.756 fused_ordering(689) 00:16:12.756 fused_ordering(690) 00:16:12.756 fused_ordering(691) 00:16:12.756 fused_ordering(692) 00:16:12.756 fused_ordering(693) 00:16:12.756 fused_ordering(694) 00:16:12.756 fused_ordering(695) 00:16:12.756 fused_ordering(696) 00:16:12.756 fused_ordering(697) 00:16:12.756 fused_ordering(698) 00:16:12.756 fused_ordering(699) 00:16:12.756 fused_ordering(700) 00:16:12.756 fused_ordering(701) 00:16:12.756 fused_ordering(702) 00:16:12.756 fused_ordering(703) 00:16:12.756 fused_ordering(704) 00:16:12.756 fused_ordering(705) 00:16:12.756 fused_ordering(706) 00:16:12.756 fused_ordering(707) 00:16:12.756 fused_ordering(708) 00:16:12.756 fused_ordering(709) 00:16:12.756 fused_ordering(710) 00:16:12.756 fused_ordering(711) 00:16:12.756 fused_ordering(712) 00:16:12.756 fused_ordering(713) 00:16:12.756 fused_ordering(714) 00:16:12.756 fused_ordering(715) 00:16:12.756 fused_ordering(716) 00:16:12.756 fused_ordering(717) 00:16:12.756 fused_ordering(718) 00:16:12.756 fused_ordering(719) 00:16:12.756 fused_ordering(720) 00:16:12.756 fused_ordering(721) 00:16:12.756 fused_ordering(722) 00:16:12.756 fused_ordering(723) 00:16:12.756 fused_ordering(724) 00:16:12.756 fused_ordering(725) 00:16:12.756 fused_ordering(726) 00:16:12.756 fused_ordering(727) 00:16:12.756 fused_ordering(728) 00:16:12.756 fused_ordering(729) 00:16:12.756 fused_ordering(730) 00:16:12.756 fused_ordering(731) 00:16:12.756 fused_ordering(732) 00:16:12.756 fused_ordering(733) 00:16:12.756 fused_ordering(734) 00:16:12.756 fused_ordering(735) 00:16:12.756 fused_ordering(736) 00:16:12.756 fused_ordering(737) 00:16:12.756 fused_ordering(738) 00:16:12.756 fused_ordering(739) 00:16:12.756 fused_ordering(740) 00:16:12.756 fused_ordering(741) 00:16:12.756 fused_ordering(742) 00:16:12.756 fused_ordering(743) 00:16:12.756 fused_ordering(744) 00:16:12.756 fused_ordering(745) 00:16:12.756 fused_ordering(746) 00:16:12.756 fused_ordering(747) 00:16:12.756 fused_ordering(748) 00:16:12.756 fused_ordering(749) 00:16:12.756 fused_ordering(750) 00:16:12.756 fused_ordering(751) 00:16:12.756 fused_ordering(752) 00:16:12.756 fused_ordering(753) 00:16:12.756 fused_ordering(754) 00:16:12.756 fused_ordering(755) 00:16:12.756 fused_ordering(756) 00:16:12.756 fused_ordering(757) 00:16:12.756 fused_ordering(758) 00:16:12.756 fused_ordering(759) 00:16:12.756 fused_ordering(760) 00:16:12.756 fused_ordering(761) 00:16:12.756 fused_ordering(762) 00:16:12.756 fused_ordering(763) 00:16:12.756 fused_ordering(764) 00:16:12.756 fused_ordering(765) 00:16:12.756 fused_ordering(766) 00:16:12.756 fused_ordering(767) 00:16:12.756 fused_ordering(768) 00:16:12.756 fused_ordering(769) 00:16:12.756 fused_ordering(770) 00:16:12.756 fused_ordering(771) 00:16:12.756 fused_ordering(772) 00:16:12.756 fused_ordering(773) 00:16:12.756 fused_ordering(774) 00:16:12.756 fused_ordering(775) 00:16:12.756 fused_ordering(776) 00:16:12.756 fused_ordering(777) 00:16:12.756 fused_ordering(778) 00:16:12.756 fused_ordering(779) 00:16:12.756 fused_ordering(780) 00:16:12.756 fused_ordering(781) 00:16:12.756 fused_ordering(782) 00:16:12.756 fused_ordering(783) 00:16:12.756 fused_ordering(784) 00:16:12.756 fused_ordering(785) 00:16:12.756 fused_ordering(786) 00:16:12.756 fused_ordering(787) 00:16:12.756 fused_ordering(788) 00:16:12.756 fused_ordering(789) 00:16:12.756 fused_ordering(790) 00:16:12.756 fused_ordering(791) 00:16:12.756 fused_ordering(792) 00:16:12.756 fused_ordering(793) 00:16:12.756 fused_ordering(794) 00:16:12.756 fused_ordering(795) 00:16:12.756 fused_ordering(796) 00:16:12.756 fused_ordering(797) 00:16:12.756 fused_ordering(798) 00:16:12.756 fused_ordering(799) 00:16:12.756 fused_ordering(800) 00:16:12.756 fused_ordering(801) 00:16:12.756 fused_ordering(802) 00:16:12.756 fused_ordering(803) 00:16:12.756 fused_ordering(804) 00:16:12.756 fused_ordering(805) 00:16:12.756 fused_ordering(806) 00:16:12.756 fused_ordering(807) 00:16:12.756 fused_ordering(808) 00:16:12.756 fused_ordering(809) 00:16:12.756 fused_ordering(810) 00:16:12.756 fused_ordering(811) 00:16:12.756 fused_ordering(812) 00:16:12.756 fused_ordering(813) 00:16:12.756 fused_ordering(814) 00:16:12.756 fused_ordering(815) 00:16:12.756 fused_ordering(816) 00:16:12.756 fused_ordering(817) 00:16:12.756 fused_ordering(818) 00:16:12.756 fused_ordering(819) 00:16:12.756 fused_ordering(820) 00:16:13.038 fused_ordering(821) 00:16:13.038 fused_ordering(822) 00:16:13.038 fused_ordering(823) 00:16:13.038 fused_ordering(824) 00:16:13.038 fused_ordering(825) 00:16:13.038 fused_ordering(826) 00:16:13.038 fused_ordering(827) 00:16:13.038 fused_ordering(828) 00:16:13.038 fused_ordering(829) 00:16:13.038 fused_ordering(830) 00:16:13.038 fused_ordering(831) 00:16:13.038 fused_ordering(832) 00:16:13.038 fused_ordering(833) 00:16:13.038 fused_ordering(834) 00:16:13.038 fused_ordering(835) 00:16:13.038 fused_ordering(836) 00:16:13.038 fused_ordering(837) 00:16:13.038 fused_ordering(838) 00:16:13.038 fused_ordering(839) 00:16:13.038 fused_ordering(840) 00:16:13.038 fused_ordering(841) 00:16:13.038 fused_ordering(842) 00:16:13.038 fused_ordering(843) 00:16:13.038 fused_ordering(844) 00:16:13.038 fused_ordering(845) 00:16:13.038 fused_ordering(846) 00:16:13.038 fused_ordering(847) 00:16:13.038 fused_ordering(848) 00:16:13.038 fused_ordering(849) 00:16:13.038 fused_ordering(850) 00:16:13.038 fused_ordering(851) 00:16:13.038 fused_ordering(852) 00:16:13.038 fused_ordering(853) 00:16:13.038 fused_ordering(854) 00:16:13.038 fused_ordering(855) 00:16:13.038 fused_ordering(856) 00:16:13.038 fused_ordering(857) 00:16:13.038 fused_ordering(858) 00:16:13.038 fused_ordering(859) 00:16:13.038 fused_ordering(860) 00:16:13.038 fused_ordering(861) 00:16:13.038 fused_ordering(862) 00:16:13.038 fused_ordering(863) 00:16:13.038 fused_ordering(864) 00:16:13.038 fused_ordering(865) 00:16:13.038 fused_ordering(866) 00:16:13.038 fused_ordering(867) 00:16:13.038 fused_ordering(868) 00:16:13.038 fused_ordering(869) 00:16:13.038 fused_ordering(870) 00:16:13.038 fused_ordering(871) 00:16:13.038 fused_ordering(872) 00:16:13.038 fused_ordering(873) 00:16:13.038 fused_ordering(874) 00:16:13.038 fused_ordering(875) 00:16:13.038 fused_ordering(876) 00:16:13.038 fused_ordering(877) 00:16:13.038 fused_ordering(878) 00:16:13.038 fused_ordering(879) 00:16:13.038 fused_ordering(880) 00:16:13.038 fused_ordering(881) 00:16:13.038 fused_ordering(882) 00:16:13.038 fused_ordering(883) 00:16:13.038 fused_ordering(884) 00:16:13.038 fused_ordering(885) 00:16:13.038 fused_ordering(886) 00:16:13.038 fused_ordering(887) 00:16:13.038 fused_ordering(888) 00:16:13.038 fused_ordering(889) 00:16:13.038 fused_ordering(890) 00:16:13.038 fused_ordering(891) 00:16:13.038 fused_ordering(892) 00:16:13.038 fused_ordering(893) 00:16:13.038 fused_ordering(894) 00:16:13.038 fused_ordering(895) 00:16:13.038 fused_ordering(896) 00:16:13.038 fused_ordering(897) 00:16:13.038 fused_ordering(898) 00:16:13.038 fused_ordering(899) 00:16:13.038 fused_ordering(900) 00:16:13.038 fused_ordering(901) 00:16:13.038 fused_ordering(902) 00:16:13.038 fused_ordering(903) 00:16:13.038 fused_ordering(904) 00:16:13.038 fused_ordering(905) 00:16:13.038 fused_ordering(906) 00:16:13.038 fused_ordering(907) 00:16:13.038 fused_ordering(908) 00:16:13.038 fused_ordering(909) 00:16:13.038 fused_ordering(910) 00:16:13.038 fused_ordering(911) 00:16:13.038 fused_ordering(912) 00:16:13.038 fused_ordering(913) 00:16:13.038 fused_ordering(914) 00:16:13.038 fused_ordering(915) 00:16:13.038 fused_ordering(916) 00:16:13.038 fused_ordering(917) 00:16:13.038 fused_ordering(918) 00:16:13.038 fused_ordering(919) 00:16:13.038 fused_ordering(920) 00:16:13.038 fused_ordering(921) 00:16:13.038 fused_ordering(922) 00:16:13.038 fused_ordering(923) 00:16:13.038 fused_ordering(924) 00:16:13.038 fused_ordering(925) 00:16:13.038 fused_ordering(926) 00:16:13.038 fused_ordering(927) 00:16:13.038 fused_ordering(928) 00:16:13.038 fused_ordering(929) 00:16:13.038 fused_ordering(930) 00:16:13.038 fused_ordering(931) 00:16:13.038 fused_ordering(932) 00:16:13.038 fused_ordering(933) 00:16:13.038 fused_ordering(934) 00:16:13.038 fused_ordering(935) 00:16:13.038 fused_ordering(936) 00:16:13.038 fused_ordering(937) 00:16:13.038 fused_ordering(938) 00:16:13.038 fused_ordering(939) 00:16:13.038 fused_ordering(940) 00:16:13.038 fused_ordering(941) 00:16:13.038 fused_ordering(942) 00:16:13.038 fused_ordering(943) 00:16:13.038 fused_ordering(944) 00:16:13.038 fused_ordering(945) 00:16:13.038 fused_ordering(946) 00:16:13.038 fused_ordering(947) 00:16:13.038 fused_ordering(948) 00:16:13.038 fused_ordering(949) 00:16:13.038 fused_ordering(950) 00:16:13.038 fused_ordering(951) 00:16:13.038 fused_ordering(952) 00:16:13.038 fused_ordering(953) 00:16:13.038 fused_ordering(954) 00:16:13.038 fused_ordering(955) 00:16:13.038 fused_ordering(956) 00:16:13.038 fused_ordering(957) 00:16:13.038 fused_ordering(958) 00:16:13.038 fused_ordering(959) 00:16:13.038 fused_ordering(960) 00:16:13.038 fused_ordering(961) 00:16:13.038 fused_ordering(962) 00:16:13.038 fused_ordering(963) 00:16:13.038 fused_ordering(964) 00:16:13.038 fused_ordering(965) 00:16:13.038 fused_ordering(966) 00:16:13.038 fused_ordering(967) 00:16:13.038 fused_ordering(968) 00:16:13.038 fused_ordering(969) 00:16:13.038 fused_ordering(970) 00:16:13.038 fused_ordering(971) 00:16:13.038 fused_ordering(972) 00:16:13.038 fused_ordering(973) 00:16:13.038 fused_ordering(974) 00:16:13.038 fused_ordering(975) 00:16:13.038 fused_ordering(976) 00:16:13.038 fused_ordering(977) 00:16:13.038 fused_ordering(978) 00:16:13.038 fused_ordering(979) 00:16:13.038 fused_ordering(980) 00:16:13.038 fused_ordering(981) 00:16:13.038 fused_ordering(982) 00:16:13.038 fused_ordering(983) 00:16:13.038 fused_ordering(984) 00:16:13.038 fused_ordering(985) 00:16:13.038 fused_ordering(986) 00:16:13.038 fused_ordering(987) 00:16:13.038 fused_ordering(988) 00:16:13.038 fused_ordering(989) 00:16:13.038 fused_ordering(990) 00:16:13.038 fused_ordering(991) 00:16:13.038 fused_ordering(992) 00:16:13.038 fused_ordering(993) 00:16:13.038 fused_ordering(994) 00:16:13.038 fused_ordering(995) 00:16:13.038 fused_ordering(996) 00:16:13.038 fused_ordering(997) 00:16:13.038 fused_ordering(998) 00:16:13.038 fused_ordering(999) 00:16:13.038 fused_ordering(1000) 00:16:13.038 fused_ordering(1001) 00:16:13.038 fused_ordering(1002) 00:16:13.038 fused_ordering(1003) 00:16:13.038 fused_ordering(1004) 00:16:13.038 fused_ordering(1005) 00:16:13.038 fused_ordering(1006) 00:16:13.038 fused_ordering(1007) 00:16:13.038 fused_ordering(1008) 00:16:13.038 fused_ordering(1009) 00:16:13.038 fused_ordering(1010) 00:16:13.038 fused_ordering(1011) 00:16:13.038 fused_ordering(1012) 00:16:13.038 fused_ordering(1013) 00:16:13.038 fused_ordering(1014) 00:16:13.038 fused_ordering(1015) 00:16:13.038 fused_ordering(1016) 00:16:13.038 fused_ordering(1017) 00:16:13.038 fused_ordering(1018) 00:16:13.038 fused_ordering(1019) 00:16:13.038 fused_ordering(1020) 00:16:13.038 fused_ordering(1021) 00:16:13.038 fused_ordering(1022) 00:16:13.038 fused_ordering(1023) 00:16:13.038 21:17:07 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:16:13.038 21:17:07 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:16:13.038 21:17:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:13.038 21:17:07 -- nvmf/common.sh@117 -- # sync 00:16:13.038 21:17:07 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:13.038 21:17:07 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:13.039 21:17:07 -- nvmf/common.sh@120 -- # set +e 00:16:13.039 21:17:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:13.039 21:17:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:13.039 rmmod nvme_rdma 00:16:13.039 rmmod nvme_fabrics 00:16:13.039 21:17:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:13.039 21:17:07 -- nvmf/common.sh@124 -- # set -e 00:16:13.039 21:17:07 -- nvmf/common.sh@125 -- # return 0 00:16:13.039 21:17:07 -- nvmf/common.sh@478 -- # '[' -n 1304363 ']' 00:16:13.039 21:17:07 -- nvmf/common.sh@479 -- # killprocess 1304363 00:16:13.039 21:17:07 -- common/autotest_common.sh@936 -- # '[' -z 1304363 ']' 00:16:13.039 21:17:07 -- common/autotest_common.sh@940 -- # kill -0 1304363 00:16:13.039 21:17:07 -- common/autotest_common.sh@941 -- # uname 00:16:13.039 21:17:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:13.039 21:17:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1304363 00:16:13.039 21:17:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:13.039 21:17:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:13.039 21:17:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1304363' 00:16:13.039 killing process with pid 1304363 00:16:13.039 21:17:07 -- common/autotest_common.sh@955 -- # kill 1304363 00:16:13.039 21:17:07 -- common/autotest_common.sh@960 -- # wait 1304363 00:16:13.039 [2024-04-23 21:17:07.226302] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:13.298 21:17:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:13.298 21:17:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:13.298 00:16:13.298 real 0m7.014s 00:16:13.298 user 0m3.953s 00:16:13.298 sys 0m4.083s 00:16:13.298 21:17:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:13.298 21:17:07 -- common/autotest_common.sh@10 -- # set +x 00:16:13.298 ************************************ 00:16:13.298 END TEST nvmf_fused_ordering 00:16:13.298 ************************************ 00:16:13.298 21:17:07 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:16:13.298 21:17:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:13.298 21:17:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:13.298 21:17:07 -- common/autotest_common.sh@10 -- # set +x 00:16:13.556 ************************************ 00:16:13.557 START TEST nvmf_delete_subsystem 00:16:13.557 ************************************ 00:16:13.557 21:17:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:16:13.557 * Looking for test storage... 00:16:13.557 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:13.557 21:17:07 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:13.557 21:17:07 -- nvmf/common.sh@7 -- # uname -s 00:16:13.557 21:17:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:13.557 21:17:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:13.557 21:17:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:13.557 21:17:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:13.557 21:17:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:13.557 21:17:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:13.557 21:17:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:13.557 21:17:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:13.557 21:17:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:13.557 21:17:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:13.557 21:17:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:13.557 21:17:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:13.557 21:17:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:13.557 21:17:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:13.557 21:17:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:13.557 21:17:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:13.557 21:17:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:13.557 21:17:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:13.557 21:17:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:13.557 21:17:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:13.557 21:17:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:13.557 21:17:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:13.557 21:17:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:13.557 21:17:07 -- paths/export.sh@5 -- # export PATH 00:16:13.557 21:17:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:13.557 21:17:07 -- nvmf/common.sh@47 -- # : 0 00:16:13.557 21:17:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:13.557 21:17:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:13.557 21:17:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:13.557 21:17:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:13.557 21:17:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:13.557 21:17:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:13.557 21:17:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:13.557 21:17:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:13.557 21:17:07 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:16:13.557 21:17:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:13.557 21:17:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:13.557 21:17:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:13.557 21:17:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:13.557 21:17:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:13.557 21:17:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:13.557 21:17:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:13.557 21:17:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:13.557 21:17:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:13.557 21:17:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:13.557 21:17:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:13.557 21:17:07 -- common/autotest_common.sh@10 -- # set +x 00:16:18.825 21:17:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:18.825 21:17:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:18.825 21:17:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:18.825 21:17:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:18.825 21:17:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:18.825 21:17:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:18.825 21:17:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:18.825 21:17:12 -- nvmf/common.sh@295 -- # net_devs=() 00:16:18.825 21:17:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:18.825 21:17:12 -- nvmf/common.sh@296 -- # e810=() 00:16:18.825 21:17:12 -- nvmf/common.sh@296 -- # local -ga e810 00:16:18.825 21:17:12 -- nvmf/common.sh@297 -- # x722=() 00:16:18.825 21:17:12 -- nvmf/common.sh@297 -- # local -ga x722 00:16:18.825 21:17:12 -- nvmf/common.sh@298 -- # mlx=() 00:16:18.825 21:17:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:18.825 21:17:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:18.825 21:17:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:18.825 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:18.825 21:17:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:18.825 21:17:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:18.825 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:18.825 21:17:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:18.825 21:17:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.825 21:17:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.825 21:17:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:18.825 Found net devices under 0000:18:00.0: mlx_0_0 00:16:18.825 21:17:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.825 21:17:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.825 21:17:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:18.825 Found net devices under 0000:18:00.1: mlx_0_1 00:16:18.825 21:17:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.825 21:17:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:18.825 21:17:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:18.825 21:17:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:18.825 21:17:12 -- nvmf/common.sh@58 -- # uname 00:16:18.825 21:17:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:18.825 21:17:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:18.825 21:17:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:18.825 21:17:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:18.825 21:17:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:18.825 21:17:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:18.825 21:17:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:18.825 21:17:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:18.825 21:17:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:18.825 21:17:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:18.825 21:17:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:18.825 21:17:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:18.825 21:17:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:18.825 21:17:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:18.825 21:17:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:18.825 21:17:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:18.825 21:17:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:18.825 21:17:12 -- nvmf/common.sh@105 -- # continue 2 00:16:18.825 21:17:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.825 21:17:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:18.825 21:17:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:18.825 21:17:12 -- nvmf/common.sh@105 -- # continue 2 00:16:18.825 21:17:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:18.825 21:17:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:18.825 21:17:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:18.825 21:17:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:18.825 21:17:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.825 21:17:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.826 21:17:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:18.826 21:17:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:18.826 21:17:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:18.826 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:18.826 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:18.826 altname enp24s0f0np0 00:16:18.826 altname ens785f0np0 00:16:18.826 inet 192.168.100.8/24 scope global mlx_0_0 00:16:18.826 valid_lft forever preferred_lft forever 00:16:18.826 21:17:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:18.826 21:17:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:18.826 21:17:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:18.826 21:17:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:18.826 21:17:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.826 21:17:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.826 21:17:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:18.826 21:17:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:18.826 21:17:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:18.826 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:18.826 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:18.826 altname enp24s0f1np1 00:16:18.826 altname ens785f1np1 00:16:18.826 inet 192.168.100.9/24 scope global mlx_0_1 00:16:18.826 valid_lft forever preferred_lft forever 00:16:18.826 21:17:13 -- nvmf/common.sh@411 -- # return 0 00:16:18.826 21:17:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:18.826 21:17:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:18.826 21:17:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:18.826 21:17:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:18.826 21:17:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:18.826 21:17:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:18.826 21:17:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:18.826 21:17:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:18.826 21:17:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:18.826 21:17:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:18.826 21:17:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.826 21:17:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.826 21:17:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:18.826 21:17:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:18.826 21:17:13 -- nvmf/common.sh@105 -- # continue 2 00:16:18.826 21:17:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:18.826 21:17:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.826 21:17:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:18.826 21:17:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:18.826 21:17:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:18.826 21:17:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:18.826 21:17:13 -- nvmf/common.sh@105 -- # continue 2 00:16:18.826 21:17:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:18.826 21:17:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:18.826 21:17:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.826 21:17:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:18.826 21:17:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:18.826 21:17:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:18.826 21:17:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:18.826 21:17:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:18.826 192.168.100.9' 00:16:18.826 21:17:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:18.826 192.168.100.9' 00:16:18.826 21:17:13 -- nvmf/common.sh@446 -- # head -n 1 00:16:18.826 21:17:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:18.826 21:17:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:18.826 192.168.100.9' 00:16:18.826 21:17:13 -- nvmf/common.sh@447 -- # tail -n +2 00:16:18.826 21:17:13 -- nvmf/common.sh@447 -- # head -n 1 00:16:18.826 21:17:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:18.826 21:17:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:18.826 21:17:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:18.826 21:17:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:18.826 21:17:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:18.826 21:17:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:18.826 21:17:13 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:16:18.826 21:17:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:18.826 21:17:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:18.826 21:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:19.085 21:17:13 -- nvmf/common.sh@470 -- # nvmfpid=1307920 00:16:19.085 21:17:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:19.085 21:17:13 -- nvmf/common.sh@471 -- # waitforlisten 1307920 00:16:19.085 21:17:13 -- common/autotest_common.sh@817 -- # '[' -z 1307920 ']' 00:16:19.085 21:17:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:19.085 21:17:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:19.085 21:17:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:19.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:19.085 21:17:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:19.085 21:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:19.085 [2024-04-23 21:17:13.141810] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:16:19.085 [2024-04-23 21:17:13.141851] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.085 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.085 [2024-04-23 21:17:13.191911] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:19.085 [2024-04-23 21:17:13.262180] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.085 [2024-04-23 21:17:13.262217] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.085 [2024-04-23 21:17:13.262225] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:19.085 [2024-04-23 21:17:13.262231] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:19.085 [2024-04-23 21:17:13.262236] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.085 [2024-04-23 21:17:13.262299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.085 [2024-04-23 21:17:13.262317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:19.650 21:17:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:19.650 21:17:13 -- common/autotest_common.sh@850 -- # return 0 00:16:19.650 21:17:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:19.650 21:17:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:19.650 21:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 21:17:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:19.909 21:17:13 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:19.909 21:17:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 [2024-04-23 21:17:13.966776] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12c2050/0x12c6540) succeed. 00:16:19.909 [2024-04-23 21:17:13.974753] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x12c3550/0x1307bd0) succeed. 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:19.909 21:17:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:19.909 21:17:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 [2024-04-23 21:17:14.063615] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:19.909 21:17:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 NULL1 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:19.909 21:17:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 Delay0 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:19.909 21:17:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.909 21:17:14 -- common/autotest_common.sh@10 -- # set +x 00:16:19.909 21:17:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@28 -- # perf_pid=1308211 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@30 -- # sleep 2 00:16:19.909 21:17:14 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:19.909 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.909 [2024-04-23 21:17:14.165800] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:22.442 21:17:16 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:22.442 21:17:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:22.442 21:17:16 -- common/autotest_common.sh@10 -- # set +x 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 NVMe io qpair process completion error 00:16:23.010 21:17:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.010 21:17:17 -- target/delete_subsystem.sh@34 -- # delay=0 00:16:23.010 21:17:17 -- target/delete_subsystem.sh@35 -- # kill -0 1308211 00:16:23.010 21:17:17 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:23.578 21:17:17 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:23.578 21:17:17 -- target/delete_subsystem.sh@35 -- # kill -0 1308211 00:16:23.578 21:17:17 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 starting I/O failed: -6 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.146 Write completed with error (sct=0, sc=8) 00:16:24.146 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 starting I/O failed: -6 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Write completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.147 Read completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 Read completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 Read completed with error (sct=0, sc=8) 00:16:24.148 Write completed with error (sct=0, sc=8) 00:16:24.148 21:17:18 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:24.148 21:17:18 -- target/delete_subsystem.sh@35 -- # kill -0 1308211 00:16:24.148 21:17:18 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:24.148 [2024-04-23 21:17:18.251310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.148 [2024-04-23 21:17:18.251344] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:24.148 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:16:24.148 Initializing NVMe Controllers 00:16:24.148 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:24.148 Controller IO queue size 128, less than required. 00:16:24.148 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:24.148 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:24.148 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:24.148 Initialization complete. Launching workers. 00:16:24.148 ======================================================== 00:16:24.148 Latency(us) 00:16:24.148 Device Information : IOPS MiB/s Average min max 00:16:24.148 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.45 0.04 1594201.15 1000086.55 2977531.14 00:16:24.148 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.45 0.04 1595558.51 1001179.28 2978451.75 00:16:24.148 ======================================================== 00:16:24.148 Total : 160.91 0.08 1594879.83 1000086.55 2978451.75 00:16:24.148 00:16:24.714 21:17:18 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:24.714 21:17:18 -- target/delete_subsystem.sh@35 -- # kill -0 1308211 00:16:24.714 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1308211) - No such process 00:16:24.714 21:17:18 -- target/delete_subsystem.sh@45 -- # NOT wait 1308211 00:16:24.714 21:17:18 -- common/autotest_common.sh@638 -- # local es=0 00:16:24.714 21:17:18 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 1308211 00:16:24.714 21:17:18 -- common/autotest_common.sh@626 -- # local arg=wait 00:16:24.714 21:17:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:24.714 21:17:18 -- common/autotest_common.sh@630 -- # type -t wait 00:16:24.714 21:17:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:24.714 21:17:18 -- common/autotest_common.sh@641 -- # wait 1308211 00:16:24.714 21:17:18 -- common/autotest_common.sh@641 -- # es=1 00:16:24.714 21:17:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:24.714 21:17:18 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:24.714 21:17:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:24.715 21:17:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:24.715 21:17:18 -- common/autotest_common.sh@10 -- # set +x 00:16:24.715 21:17:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:24.715 21:17:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:24.715 21:17:18 -- common/autotest_common.sh@10 -- # set +x 00:16:24.715 [2024-04-23 21:17:18.769123] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:24.715 21:17:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:24.715 21:17:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:24.715 21:17:18 -- common/autotest_common.sh@10 -- # set +x 00:16:24.715 21:17:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@54 -- # perf_pid=1309049 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@56 -- # delay=0 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:24.715 21:17:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:24.715 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.715 [2024-04-23 21:17:18.849067] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:25.282 21:17:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:25.282 21:17:19 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:25.282 21:17:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:25.540 21:17:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:25.540 21:17:19 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:25.540 21:17:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:26.106 21:17:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:26.106 21:17:20 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:26.106 21:17:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:26.673 21:17:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:26.673 21:17:20 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:26.673 21:17:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:27.241 21:17:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:27.241 21:17:21 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:27.241 21:17:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:27.807 21:17:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:27.807 21:17:21 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:27.807 21:17:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:28.065 21:17:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:28.065 21:17:22 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:28.065 21:17:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:28.633 21:17:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:28.633 21:17:22 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:28.633 21:17:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:29.200 21:17:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:29.200 21:17:23 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:29.200 21:17:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:29.767 21:17:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:29.767 21:17:23 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:29.767 21:17:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:30.336 21:17:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:30.336 21:17:24 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:30.336 21:17:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:30.594 21:17:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:30.594 21:17:24 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:30.594 21:17:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:31.197 21:17:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:31.197 21:17:25 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:31.197 21:17:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:31.764 21:17:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:31.764 21:17:25 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:31.764 21:17:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:31.764 Initializing NVMe Controllers 00:16:31.764 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:31.764 Controller IO queue size 128, less than required. 00:16:31.764 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:31.764 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:31.764 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:31.764 Initialization complete. Launching workers. 00:16:31.764 ======================================================== 00:16:31.765 Latency(us) 00:16:31.765 Device Information : IOPS MiB/s Average min max 00:16:31.765 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001309.94 1000056.79 1003890.56 00:16:31.765 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002479.14 1000243.30 1005964.70 00:16:31.765 ======================================================== 00:16:31.765 Total : 256.00 0.12 1001894.54 1000056.79 1005964.70 00:16:31.765 00:16:32.334 21:17:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:32.334 21:17:26 -- target/delete_subsystem.sh@57 -- # kill -0 1309049 00:16:32.334 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1309049) - No such process 00:16:32.334 21:17:26 -- target/delete_subsystem.sh@67 -- # wait 1309049 00:16:32.334 21:17:26 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:16:32.334 21:17:26 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:16:32.334 21:17:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:32.334 21:17:26 -- nvmf/common.sh@117 -- # sync 00:16:32.334 21:17:26 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:32.334 21:17:26 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:32.334 21:17:26 -- nvmf/common.sh@120 -- # set +e 00:16:32.334 21:17:26 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:32.334 21:17:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:32.334 rmmod nvme_rdma 00:16:32.334 rmmod nvme_fabrics 00:16:32.334 21:17:26 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:32.334 21:17:26 -- nvmf/common.sh@124 -- # set -e 00:16:32.334 21:17:26 -- nvmf/common.sh@125 -- # return 0 00:16:32.334 21:17:26 -- nvmf/common.sh@478 -- # '[' -n 1307920 ']' 00:16:32.334 21:17:26 -- nvmf/common.sh@479 -- # killprocess 1307920 00:16:32.334 21:17:26 -- common/autotest_common.sh@936 -- # '[' -z 1307920 ']' 00:16:32.334 21:17:26 -- common/autotest_common.sh@940 -- # kill -0 1307920 00:16:32.334 21:17:26 -- common/autotest_common.sh@941 -- # uname 00:16:32.334 21:17:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:32.334 21:17:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1307920 00:16:32.334 21:17:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:32.334 21:17:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:32.334 21:17:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1307920' 00:16:32.334 killing process with pid 1307920 00:16:32.334 21:17:26 -- common/autotest_common.sh@955 -- # kill 1307920 00:16:32.334 21:17:26 -- common/autotest_common.sh@960 -- # wait 1307920 00:16:32.335 [2024-04-23 21:17:26.488715] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:32.593 21:17:26 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:32.593 21:17:26 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:32.593 00:16:32.593 real 0m19.109s 00:16:32.593 user 0m49.752s 00:16:32.593 sys 0m5.051s 00:16:32.593 21:17:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:32.593 21:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:32.593 ************************************ 00:16:32.593 END TEST nvmf_delete_subsystem 00:16:32.593 ************************************ 00:16:32.593 21:17:26 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:16:32.593 21:17:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:32.593 21:17:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:32.593 21:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:32.593 ************************************ 00:16:32.593 START TEST nvmf_ns_masking 00:16:32.593 ************************************ 00:16:32.593 21:17:26 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:16:32.852 * Looking for test storage... 00:16:32.852 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:32.852 21:17:26 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:32.852 21:17:26 -- nvmf/common.sh@7 -- # uname -s 00:16:32.852 21:17:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:32.852 21:17:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:32.852 21:17:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:32.852 21:17:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:32.852 21:17:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:32.852 21:17:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:32.852 21:17:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:32.852 21:17:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:32.852 21:17:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:32.852 21:17:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:32.852 21:17:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:32.852 21:17:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:32.852 21:17:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:32.852 21:17:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:32.852 21:17:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:32.852 21:17:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:32.852 21:17:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:32.852 21:17:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:32.852 21:17:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:32.852 21:17:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:32.852 21:17:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.852 21:17:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.852 21:17:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.852 21:17:26 -- paths/export.sh@5 -- # export PATH 00:16:32.852 21:17:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:32.852 21:17:26 -- nvmf/common.sh@47 -- # : 0 00:16:32.852 21:17:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:32.852 21:17:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:32.852 21:17:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:32.852 21:17:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:32.852 21:17:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:32.853 21:17:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:32.853 21:17:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:32.853 21:17:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:32.853 21:17:26 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:32.853 21:17:26 -- target/ns_masking.sh@11 -- # loops=5 00:16:32.853 21:17:26 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:16:32.853 21:17:26 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:16:32.853 21:17:26 -- target/ns_masking.sh@15 -- # uuidgen 00:16:32.853 21:17:26 -- target/ns_masking.sh@15 -- # HOSTID=63f70192-fd28-44ba-959f-780db48cbd1f 00:16:32.853 21:17:26 -- target/ns_masking.sh@44 -- # nvmftestinit 00:16:32.853 21:17:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:32.853 21:17:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:32.853 21:17:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:32.853 21:17:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:32.853 21:17:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:32.853 21:17:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.853 21:17:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.853 21:17:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:32.853 21:17:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:32.853 21:17:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:32.853 21:17:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:32.853 21:17:26 -- common/autotest_common.sh@10 -- # set +x 00:16:38.129 21:17:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:38.129 21:17:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:38.129 21:17:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:38.129 21:17:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:38.129 21:17:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:38.129 21:17:32 -- nvmf/common.sh@295 -- # net_devs=() 00:16:38.129 21:17:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@296 -- # e810=() 00:16:38.129 21:17:32 -- nvmf/common.sh@296 -- # local -ga e810 00:16:38.129 21:17:32 -- nvmf/common.sh@297 -- # x722=() 00:16:38.129 21:17:32 -- nvmf/common.sh@297 -- # local -ga x722 00:16:38.129 21:17:32 -- nvmf/common.sh@298 -- # mlx=() 00:16:38.129 21:17:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:38.129 21:17:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:38.129 21:17:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:38.129 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:38.129 21:17:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:38.129 21:17:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:38.129 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:38.129 21:17:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:38.129 21:17:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.129 21:17:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.129 21:17:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:38.129 Found net devices under 0000:18:00.0: mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:38.129 21:17:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:38.129 21:17:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:38.129 Found net devices under 0000:18:00.1: mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:38.129 21:17:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:38.129 21:17:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:38.129 21:17:32 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:38.129 21:17:32 -- nvmf/common.sh@58 -- # uname 00:16:38.129 21:17:32 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:38.129 21:17:32 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:38.129 21:17:32 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:38.129 21:17:32 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:38.129 21:17:32 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:38.129 21:17:32 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:38.129 21:17:32 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:38.129 21:17:32 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:38.129 21:17:32 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:38.129 21:17:32 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:38.129 21:17:32 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:38.129 21:17:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:38.129 21:17:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:38.129 21:17:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@105 -- # continue 2 00:16:38.129 21:17:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@105 -- # continue 2 00:16:38.129 21:17:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:38.129 21:17:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:38.129 21:17:32 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:38.129 21:17:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:38.129 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:38.129 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:38.129 altname enp24s0f0np0 00:16:38.129 altname ens785f0np0 00:16:38.129 inet 192.168.100.8/24 scope global mlx_0_0 00:16:38.129 valid_lft forever preferred_lft forever 00:16:38.129 21:17:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:38.129 21:17:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:38.129 21:17:32 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:38.129 21:17:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:38.129 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:38.129 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:38.129 altname enp24s0f1np1 00:16:38.129 altname ens785f1np1 00:16:38.129 inet 192.168.100.9/24 scope global mlx_0_1 00:16:38.129 valid_lft forever preferred_lft forever 00:16:38.129 21:17:32 -- nvmf/common.sh@411 -- # return 0 00:16:38.129 21:17:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:38.129 21:17:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:38.129 21:17:32 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:38.129 21:17:32 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:38.129 21:17:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:38.129 21:17:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:38.129 21:17:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:38.129 21:17:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:38.129 21:17:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@105 -- # continue 2 00:16:38.129 21:17:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:38.129 21:17:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:38.129 21:17:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@105 -- # continue 2 00:16:38.129 21:17:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:38.129 21:17:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:38.129 21:17:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:38.129 21:17:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:38.129 21:17:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:38.129 21:17:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:38.129 192.168.100.9' 00:16:38.129 21:17:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:38.129 192.168.100.9' 00:16:38.129 21:17:32 -- nvmf/common.sh@446 -- # head -n 1 00:16:38.129 21:17:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:38.129 21:17:32 -- nvmf/common.sh@447 -- # head -n 1 00:16:38.129 21:17:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:38.129 192.168.100.9' 00:16:38.129 21:17:32 -- nvmf/common.sh@447 -- # tail -n +2 00:16:38.129 21:17:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:38.129 21:17:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:38.129 21:17:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:38.129 21:17:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:38.129 21:17:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:38.129 21:17:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:38.129 21:17:32 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:16:38.129 21:17:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:38.129 21:17:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:38.129 21:17:32 -- common/autotest_common.sh@10 -- # set +x 00:16:38.129 21:17:32 -- nvmf/common.sh@470 -- # nvmfpid=1313666 00:16:38.129 21:17:32 -- nvmf/common.sh@471 -- # waitforlisten 1313666 00:16:38.129 21:17:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:38.129 21:17:32 -- common/autotest_common.sh@817 -- # '[' -z 1313666 ']' 00:16:38.129 21:17:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:38.129 21:17:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:38.129 21:17:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:38.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:38.129 21:17:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:38.129 21:17:32 -- common/autotest_common.sh@10 -- # set +x 00:16:38.129 [2024-04-23 21:17:32.328441] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:16:38.129 [2024-04-23 21:17:32.328485] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:38.129 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.129 [2024-04-23 21:17:32.379937] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:38.387 [2024-04-23 21:17:32.454245] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:38.387 [2024-04-23 21:17:32.454285] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:38.387 [2024-04-23 21:17:32.454294] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:38.387 [2024-04-23 21:17:32.454301] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:38.387 [2024-04-23 21:17:32.454306] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:38.387 [2024-04-23 21:17:32.454348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:38.387 [2024-04-23 21:17:32.454435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.387 [2024-04-23 21:17:32.454521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:38.387 [2024-04-23 21:17:32.454525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:38.952 21:17:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:38.952 21:17:33 -- common/autotest_common.sh@850 -- # return 0 00:16:38.952 21:17:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:38.952 21:17:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:38.952 21:17:33 -- common/autotest_common.sh@10 -- # set +x 00:16:38.952 21:17:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:38.952 21:17:33 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:39.211 [2024-04-23 21:17:33.310800] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22eb6b0/0x22efba0) succeed. 00:16:39.211 [2024-04-23 21:17:33.320169] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22eccf0/0x2331230) succeed. 00:16:39.211 21:17:33 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:16:39.211 21:17:33 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:16:39.211 21:17:33 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:39.470 Malloc1 00:16:39.470 21:17:33 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:39.728 Malloc2 00:16:39.728 21:17:33 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:39.728 21:17:33 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:16:39.986 21:17:34 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:40.244 [2024-04-23 21:17:34.283503] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:40.244 21:17:34 -- target/ns_masking.sh@61 -- # connect 00:16:40.244 21:17:34 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 63f70192-fd28-44ba-959f-780db48cbd1f -a 192.168.100.8 -s 4420 -i 4 00:16:40.502 21:17:34 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:16:40.502 21:17:34 -- common/autotest_common.sh@1184 -- # local i=0 00:16:40.502 21:17:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:40.502 21:17:34 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:16:40.502 21:17:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:42.401 21:17:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:42.401 21:17:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:42.401 21:17:36 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:42.401 21:17:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:16:42.401 21:17:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:42.401 21:17:36 -- common/autotest_common.sh@1194 -- # return 0 00:16:42.401 21:17:36 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:42.401 21:17:36 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:42.660 21:17:36 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:42.660 21:17:36 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:42.660 21:17:36 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:42.660 [ 0]:0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:42.660 21:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:42.660 21:17:36 -- target/ns_masking.sh@40 -- # nguid=127a590f9a4844abb2e733d9718f3044 00:16:42.660 21:17:36 -- target/ns_masking.sh@41 -- # [[ 127a590f9a4844abb2e733d9718f3044 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:42.660 21:17:36 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:16:42.660 21:17:36 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:42.660 [ 0]:0x1 00:16:42.660 21:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:42.660 21:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:42.918 21:17:36 -- target/ns_masking.sh@40 -- # nguid=127a590f9a4844abb2e733d9718f3044 00:16:42.918 21:17:36 -- target/ns_masking.sh@41 -- # [[ 127a590f9a4844abb2e733d9718f3044 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:42.918 21:17:36 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:16:42.918 21:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:42.918 21:17:36 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:42.918 [ 1]:0x2 00:16:42.918 21:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:42.918 21:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:42.918 21:17:36 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:42.918 21:17:36 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:42.918 21:17:36 -- target/ns_masking.sh@69 -- # disconnect 00:16:42.918 21:17:36 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:43.176 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:43.176 21:17:37 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:43.435 21:17:37 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:16:43.435 21:17:37 -- target/ns_masking.sh@77 -- # connect 1 00:16:43.435 21:17:37 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 63f70192-fd28-44ba-959f-780db48cbd1f -a 192.168.100.8 -s 4420 -i 4 00:16:44.002 21:17:37 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:16:44.002 21:17:37 -- common/autotest_common.sh@1184 -- # local i=0 00:16:44.002 21:17:37 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:44.002 21:17:37 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:16:44.002 21:17:37 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:16:44.002 21:17:37 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:45.907 21:17:39 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:45.907 21:17:39 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:45.907 21:17:39 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:45.907 21:17:40 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:16:45.907 21:17:40 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:45.907 21:17:40 -- common/autotest_common.sh@1194 -- # return 0 00:16:45.907 21:17:40 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:45.907 21:17:40 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:45.907 21:17:40 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:45.907 21:17:40 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:45.907 21:17:40 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:16:45.907 21:17:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:45.907 21:17:40 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:45.907 21:17:40 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:45.907 21:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:45.907 21:17:40 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:45.907 21:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:45.907 21:17:40 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:45.907 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:45.907 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:45.907 21:17:40 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:45.907 21:17:40 -- common/autotest_common.sh@641 -- # es=1 00:16:45.907 21:17:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:45.907 21:17:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:45.907 21:17:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:45.907 21:17:40 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:16:45.907 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:45.907 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:45.907 [ 0]:0x2 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:45.907 21:17:40 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:45.907 21:17:40 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:45.907 21:17:40 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:46.166 21:17:40 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:16:46.166 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:46.166 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:46.166 [ 0]:0x1 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # nguid=127a590f9a4844abb2e733d9718f3044 00:16:46.166 21:17:40 -- target/ns_masking.sh@41 -- # [[ 127a590f9a4844abb2e733d9718f3044 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:46.166 21:17:40 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:16:46.166 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:46.166 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:46.166 [ 1]:0x2 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:46.166 21:17:40 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:46.166 21:17:40 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:46.166 21:17:40 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:46.425 21:17:40 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:16:46.425 21:17:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:46.425 21:17:40 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:46.425 21:17:40 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:46.425 21:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:46.425 21:17:40 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:46.425 21:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:46.425 21:17:40 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:46.425 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:46.425 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:46.425 21:17:40 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:46.425 21:17:40 -- common/autotest_common.sh@641 -- # es=1 00:16:46.425 21:17:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:46.425 21:17:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:46.425 21:17:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:46.425 21:17:40 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:16:46.425 21:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:46.425 21:17:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:46.425 [ 0]:0x2 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:46.425 21:17:40 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:46.684 21:17:40 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:46.684 21:17:40 -- target/ns_masking.sh@91 -- # disconnect 00:16:46.685 21:17:40 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:46.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:46.944 21:17:41 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:46.944 21:17:41 -- target/ns_masking.sh@95 -- # connect 2 00:16:46.944 21:17:41 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 63f70192-fd28-44ba-959f-780db48cbd1f -a 192.168.100.8 -s 4420 -i 4 00:16:47.203 21:17:41 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:16:47.203 21:17:41 -- common/autotest_common.sh@1184 -- # local i=0 00:16:47.203 21:17:41 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:47.203 21:17:41 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:16:47.203 21:17:41 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:16:47.203 21:17:41 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:49.739 21:17:43 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:49.739 21:17:43 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:49.739 21:17:43 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:49.739 21:17:43 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:16:49.739 21:17:43 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:49.739 21:17:43 -- common/autotest_common.sh@1194 -- # return 0 00:16:49.739 21:17:43 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:49.739 21:17:43 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:49.739 21:17:43 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:49.739 21:17:43 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:49.739 21:17:43 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:49.739 [ 0]:0x1 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nguid=127a590f9a4844abb2e733d9718f3044 00:16:49.739 21:17:43 -- target/ns_masking.sh@41 -- # [[ 127a590f9a4844abb2e733d9718f3044 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:49.739 21:17:43 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:49.739 [ 1]:0x2 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:49.739 21:17:43 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:49.739 21:17:43 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:49.739 21:17:43 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:16:49.739 21:17:43 -- common/autotest_common.sh@638 -- # local es=0 00:16:49.739 21:17:43 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:49.739 21:17:43 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:49.739 21:17:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:49.739 21:17:43 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:49.739 21:17:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:49.739 21:17:43 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:49.739 21:17:43 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:49.739 21:17:43 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:49.739 21:17:43 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:49.739 21:17:43 -- common/autotest_common.sh@641 -- # es=1 00:16:49.740 21:17:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:49.740 21:17:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:49.740 21:17:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:49.740 21:17:43 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:16:49.740 21:17:43 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:49.740 21:17:43 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:49.740 [ 0]:0x2 00:16:49.740 21:17:43 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:49.740 21:17:43 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:49.740 21:17:43 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:49.740 21:17:43 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:49.740 21:17:43 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:49.740 21:17:43 -- common/autotest_common.sh@638 -- # local es=0 00:16:49.740 21:17:43 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:49.740 21:17:43 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:49.740 21:17:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:49.740 21:17:43 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:49.740 21:17:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:49.740 21:17:43 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:49.740 21:17:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:49.740 21:17:43 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:49.740 21:17:43 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:16:49.740 21:17:43 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:50.040 [2024-04-23 21:17:44.032173] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:16:50.040 request: 00:16:50.040 { 00:16:50.040 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:50.040 "nsid": 2, 00:16:50.040 "host": "nqn.2016-06.io.spdk:host1", 00:16:50.040 "method": "nvmf_ns_remove_host", 00:16:50.040 "req_id": 1 00:16:50.040 } 00:16:50.040 Got JSON-RPC error response 00:16:50.040 response: 00:16:50.040 { 00:16:50.040 "code": -32602, 00:16:50.040 "message": "Invalid parameters" 00:16:50.040 } 00:16:50.040 21:17:44 -- common/autotest_common.sh@641 -- # es=1 00:16:50.040 21:17:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:50.040 21:17:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:50.040 21:17:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:50.040 21:17:44 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:16:50.040 21:17:44 -- common/autotest_common.sh@638 -- # local es=0 00:16:50.041 21:17:44 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:50.041 21:17:44 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:50.041 21:17:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:50.041 21:17:44 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:50.041 21:17:44 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:50.041 21:17:44 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:50.041 21:17:44 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:50.041 21:17:44 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:50.041 21:17:44 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:50.041 21:17:44 -- common/autotest_common.sh@641 -- # es=1 00:16:50.041 21:17:44 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:50.041 21:17:44 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:50.041 21:17:44 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:50.041 21:17:44 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:16:50.041 21:17:44 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:50.041 21:17:44 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:50.041 [ 0]:0x2 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:50.041 21:17:44 -- target/ns_masking.sh@40 -- # nguid=65945c73503f4451ab70dc129e71ee0a 00:16:50.041 21:17:44 -- target/ns_masking.sh@41 -- # [[ 65945c73503f4451ab70dc129e71ee0a != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:50.041 21:17:44 -- target/ns_masking.sh@108 -- # disconnect 00:16:50.041 21:17:44 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:50.300 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:50.300 21:17:44 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:50.559 21:17:44 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:16:50.559 21:17:44 -- target/ns_masking.sh@114 -- # nvmftestfini 00:16:50.559 21:17:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:50.559 21:17:44 -- nvmf/common.sh@117 -- # sync 00:16:50.559 21:17:44 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:50.559 21:17:44 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:50.559 21:17:44 -- nvmf/common.sh@120 -- # set +e 00:16:50.559 21:17:44 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:50.559 21:17:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:50.559 rmmod nvme_rdma 00:16:50.559 rmmod nvme_fabrics 00:16:50.559 21:17:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:50.559 21:17:44 -- nvmf/common.sh@124 -- # set -e 00:16:50.559 21:17:44 -- nvmf/common.sh@125 -- # return 0 00:16:50.559 21:17:44 -- nvmf/common.sh@478 -- # '[' -n 1313666 ']' 00:16:50.559 21:17:44 -- nvmf/common.sh@479 -- # killprocess 1313666 00:16:50.559 21:17:44 -- common/autotest_common.sh@936 -- # '[' -z 1313666 ']' 00:16:50.559 21:17:44 -- common/autotest_common.sh@940 -- # kill -0 1313666 00:16:50.559 21:17:44 -- common/autotest_common.sh@941 -- # uname 00:16:50.559 21:17:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:50.559 21:17:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1313666 00:16:50.559 21:17:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:50.559 21:17:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:50.559 21:17:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1313666' 00:16:50.559 killing process with pid 1313666 00:16:50.559 21:17:44 -- common/autotest_common.sh@955 -- # kill 1313666 00:16:50.559 21:17:44 -- common/autotest_common.sh@960 -- # wait 1313666 00:16:50.559 [2024-04-23 21:17:44.828117] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:50.819 21:17:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:50.819 21:17:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:50.819 00:16:50.819 real 0m18.241s 00:16:50.819 user 0m54.392s 00:16:50.819 sys 0m5.285s 00:16:50.819 21:17:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:50.819 21:17:45 -- common/autotest_common.sh@10 -- # set +x 00:16:50.819 ************************************ 00:16:50.819 END TEST nvmf_ns_masking 00:16:50.819 ************************************ 00:16:51.079 21:17:45 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:16:51.079 21:17:45 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:16:51.079 21:17:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:51.079 21:17:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:51.079 21:17:45 -- common/autotest_common.sh@10 -- # set +x 00:16:51.079 ************************************ 00:16:51.079 START TEST nvmf_nvme_cli 00:16:51.079 ************************************ 00:16:51.079 21:17:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:16:51.079 * Looking for test storage... 00:16:51.079 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:51.079 21:17:45 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:51.079 21:17:45 -- nvmf/common.sh@7 -- # uname -s 00:16:51.079 21:17:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:51.079 21:17:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:51.079 21:17:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:51.079 21:17:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:51.079 21:17:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:51.079 21:17:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:51.079 21:17:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:51.079 21:17:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:51.079 21:17:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:51.079 21:17:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:51.079 21:17:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:51.079 21:17:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:51.079 21:17:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:51.079 21:17:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:51.079 21:17:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:51.079 21:17:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:51.079 21:17:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:51.079 21:17:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:51.079 21:17:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:51.079 21:17:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:51.079 21:17:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.079 21:17:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.079 21:17:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.079 21:17:45 -- paths/export.sh@5 -- # export PATH 00:16:51.079 21:17:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.079 21:17:45 -- nvmf/common.sh@47 -- # : 0 00:16:51.079 21:17:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:51.079 21:17:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:51.079 21:17:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:51.079 21:17:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:51.079 21:17:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:51.079 21:17:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:51.079 21:17:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:51.079 21:17:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:51.079 21:17:45 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:51.079 21:17:45 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:51.079 21:17:45 -- target/nvme_cli.sh@14 -- # devs=() 00:16:51.079 21:17:45 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:16:51.079 21:17:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:51.079 21:17:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:51.079 21:17:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:51.079 21:17:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:51.079 21:17:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:51.079 21:17:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:51.079 21:17:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:51.079 21:17:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:51.079 21:17:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:51.079 21:17:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:51.338 21:17:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:51.338 21:17:45 -- common/autotest_common.sh@10 -- # set +x 00:16:56.610 21:17:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:56.610 21:17:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:56.610 21:17:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:56.610 21:17:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:56.610 21:17:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:56.610 21:17:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:56.610 21:17:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:56.610 21:17:50 -- nvmf/common.sh@295 -- # net_devs=() 00:16:56.610 21:17:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:56.610 21:17:50 -- nvmf/common.sh@296 -- # e810=() 00:16:56.610 21:17:50 -- nvmf/common.sh@296 -- # local -ga e810 00:16:56.610 21:17:50 -- nvmf/common.sh@297 -- # x722=() 00:16:56.610 21:17:50 -- nvmf/common.sh@297 -- # local -ga x722 00:16:56.610 21:17:50 -- nvmf/common.sh@298 -- # mlx=() 00:16:56.610 21:17:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:56.610 21:17:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:56.610 21:17:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:56.610 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:56.610 21:17:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.610 21:17:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:56.610 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:56.610 21:17:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.610 21:17:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.610 21:17:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.610 21:17:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:56.610 Found net devices under 0000:18:00.0: mlx_0_0 00:16:56.610 21:17:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.610 21:17:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.610 21:17:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:56.610 Found net devices under 0000:18:00.1: mlx_0_1 00:16:56.610 21:17:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.610 21:17:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:56.610 21:17:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:56.610 21:17:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:56.610 21:17:50 -- nvmf/common.sh@58 -- # uname 00:16:56.610 21:17:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:56.610 21:17:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:56.610 21:17:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:56.610 21:17:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:56.610 21:17:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:56.610 21:17:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:56.610 21:17:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:56.610 21:17:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:56.610 21:17:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:56.610 21:17:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:56.610 21:17:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:56.610 21:17:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.610 21:17:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.610 21:17:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.610 21:17:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.610 21:17:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.610 21:17:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:56.610 21:17:50 -- nvmf/common.sh@105 -- # continue 2 00:16:56.610 21:17:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.610 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:56.610 21:17:50 -- nvmf/common.sh@105 -- # continue 2 00:16:56.610 21:17:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.610 21:17:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:56.610 21:17:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.610 21:17:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:56.610 21:17:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:56.610 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:56.610 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:56.610 altname enp24s0f0np0 00:16:56.610 altname ens785f0np0 00:16:56.610 inet 192.168.100.8/24 scope global mlx_0_0 00:16:56.610 valid_lft forever preferred_lft forever 00:16:56.610 21:17:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.610 21:17:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:56.610 21:17:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.610 21:17:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.610 21:17:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:56.610 21:17:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:56.610 21:17:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:56.610 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:56.610 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:56.610 altname enp24s0f1np1 00:16:56.610 altname ens785f1np1 00:16:56.610 inet 192.168.100.9/24 scope global mlx_0_1 00:16:56.610 valid_lft forever preferred_lft forever 00:16:56.610 21:17:50 -- nvmf/common.sh@411 -- # return 0 00:16:56.610 21:17:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:56.611 21:17:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:56.611 21:17:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:56.611 21:17:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:56.611 21:17:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:56.611 21:17:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.611 21:17:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.611 21:17:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.611 21:17:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.611 21:17:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.611 21:17:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.611 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.611 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:56.611 21:17:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:56.611 21:17:50 -- nvmf/common.sh@105 -- # continue 2 00:16:56.611 21:17:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.611 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.611 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:56.611 21:17:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.611 21:17:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:56.611 21:17:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:56.611 21:17:50 -- nvmf/common.sh@105 -- # continue 2 00:16:56.611 21:17:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.611 21:17:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:56.611 21:17:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.611 21:17:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.611 21:17:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:56.611 21:17:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.611 21:17:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.611 21:17:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:56.611 192.168.100.9' 00:16:56.611 21:17:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:56.611 192.168.100.9' 00:16:56.611 21:17:50 -- nvmf/common.sh@446 -- # head -n 1 00:16:56.611 21:17:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:56.611 21:17:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:56.611 192.168.100.9' 00:16:56.611 21:17:50 -- nvmf/common.sh@447 -- # tail -n +2 00:16:56.611 21:17:50 -- nvmf/common.sh@447 -- # head -n 1 00:16:56.611 21:17:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:56.611 21:17:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:56.611 21:17:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:56.611 21:17:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:56.611 21:17:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:56.611 21:17:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:56.611 21:17:50 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:16:56.611 21:17:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:56.611 21:17:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:56.611 21:17:50 -- common/autotest_common.sh@10 -- # set +x 00:16:56.611 21:17:50 -- nvmf/common.sh@470 -- # nvmfpid=1319566 00:16:56.611 21:17:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:56.611 21:17:50 -- nvmf/common.sh@471 -- # waitforlisten 1319566 00:16:56.611 21:17:50 -- common/autotest_common.sh@817 -- # '[' -z 1319566 ']' 00:16:56.611 21:17:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:56.611 21:17:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:56.611 21:17:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:56.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:56.611 21:17:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:56.611 21:17:50 -- common/autotest_common.sh@10 -- # set +x 00:16:56.611 [2024-04-23 21:17:50.808405] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:16:56.611 [2024-04-23 21:17:50.808448] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:56.611 EAL: No free 2048 kB hugepages reported on node 1 00:16:56.611 [2024-04-23 21:17:50.860401] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:56.870 [2024-04-23 21:17:50.931082] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:56.870 [2024-04-23 21:17:50.931124] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:56.870 [2024-04-23 21:17:50.931131] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:56.870 [2024-04-23 21:17:50.931136] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:56.870 [2024-04-23 21:17:50.931140] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:56.870 [2024-04-23 21:17:50.931195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:56.870 [2024-04-23 21:17:50.931296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.870 [2024-04-23 21:17:50.931342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:56.870 [2024-04-23 21:17:50.931344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:57.439 21:17:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:57.439 21:17:51 -- common/autotest_common.sh@850 -- # return 0 00:16:57.439 21:17:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:57.439 21:17:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:57.439 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.439 21:17:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:57.439 21:17:51 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:57.439 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.439 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.439 [2024-04-23 21:17:51.642302] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb1d6b0/0xb21ba0) succeed. 00:16:57.439 [2024-04-23 21:17:51.651471] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb1ecf0/0xb63230) succeed. 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 Malloc0 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 Malloc1 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 [2024-04-23 21:17:51.835114] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:16:57.699 21:17:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.699 21:17:51 -- common/autotest_common.sh@10 -- # set +x 00:16:57.699 21:17:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.699 21:17:51 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:16:57.699 00:16:57.699 Discovery Log Number of Records 2, Generation counter 2 00:16:57.699 =====Discovery Log Entry 0====== 00:16:57.699 trtype: rdma 00:16:57.699 adrfam: ipv4 00:16:57.699 subtype: current discovery subsystem 00:16:57.699 treq: not required 00:16:57.699 portid: 0 00:16:57.699 trsvcid: 4420 00:16:57.699 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:16:57.699 traddr: 192.168.100.8 00:16:57.699 eflags: explicit discovery connections, duplicate discovery information 00:16:57.699 rdma_prtype: not specified 00:16:57.699 rdma_qptype: connected 00:16:57.699 rdma_cms: rdma-cm 00:16:57.699 rdma_pkey: 0x0000 00:16:57.699 =====Discovery Log Entry 1====== 00:16:57.699 trtype: rdma 00:16:57.699 adrfam: ipv4 00:16:57.699 subtype: nvme subsystem 00:16:57.699 treq: not required 00:16:57.699 portid: 0 00:16:57.699 trsvcid: 4420 00:16:57.699 subnqn: nqn.2016-06.io.spdk:cnode1 00:16:57.699 traddr: 192.168.100.8 00:16:57.699 eflags: none 00:16:57.699 rdma_prtype: not specified 00:16:57.699 rdma_qptype: connected 00:16:57.699 rdma_cms: rdma-cm 00:16:57.699 rdma_pkey: 0x0000 00:16:57.699 21:17:51 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:16:57.699 21:17:51 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:16:57.699 21:17:51 -- nvmf/common.sh@511 -- # local dev _ 00:16:57.699 21:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:57.699 21:17:51 -- nvmf/common.sh@510 -- # nvme list 00:16:57.699 21:17:51 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:16:57.699 21:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:57.699 21:17:51 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:16:57.699 21:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:57.699 21:17:51 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:16:57.699 21:17:51 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:16:58.638 21:17:52 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:16:58.638 21:17:52 -- common/autotest_common.sh@1184 -- # local i=0 00:16:58.638 21:17:52 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:58.638 21:17:52 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:16:58.638 21:17:52 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:16:58.638 21:17:52 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:01.168 21:17:54 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:01.168 21:17:54 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:01.168 21:17:54 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:01.168 21:17:54 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:17:01.168 21:17:54 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:01.168 21:17:54 -- common/autotest_common.sh@1194 -- # return 0 00:17:01.168 21:17:54 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:17:01.168 21:17:54 -- nvmf/common.sh@511 -- # local dev _ 00:17:01.168 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.168 21:17:54 -- nvmf/common.sh@510 -- # nvme list 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:17:01.169 /dev/nvme0n1 ]] 00:17:01.169 21:17:54 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:17:01.169 21:17:54 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:17:01.169 21:17:54 -- nvmf/common.sh@511 -- # local dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@510 -- # nvme list 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:17:01.169 21:17:54 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:17:01.169 21:17:54 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:01.169 21:17:54 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:17:01.169 21:17:54 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:01.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:01.736 21:17:55 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:01.736 21:17:55 -- common/autotest_common.sh@1205 -- # local i=0 00:17:01.736 21:17:55 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:01.736 21:17:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:01.736 21:17:55 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:01.737 21:17:55 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:01.737 21:17:55 -- common/autotest_common.sh@1217 -- # return 0 00:17:01.737 21:17:55 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:17:01.737 21:17:55 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:01.737 21:17:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:01.737 21:17:55 -- common/autotest_common.sh@10 -- # set +x 00:17:01.737 21:17:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:01.737 21:17:55 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:17:01.737 21:17:55 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:17:01.737 21:17:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:01.737 21:17:55 -- nvmf/common.sh@117 -- # sync 00:17:01.737 21:17:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:01.737 21:17:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:01.737 21:17:55 -- nvmf/common.sh@120 -- # set +e 00:17:01.737 21:17:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:01.737 21:17:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:01.737 rmmod nvme_rdma 00:17:01.737 rmmod nvme_fabrics 00:17:01.737 21:17:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:01.737 21:17:56 -- nvmf/common.sh@124 -- # set -e 00:17:01.737 21:17:56 -- nvmf/common.sh@125 -- # return 0 00:17:01.737 21:17:56 -- nvmf/common.sh@478 -- # '[' -n 1319566 ']' 00:17:01.737 21:17:56 -- nvmf/common.sh@479 -- # killprocess 1319566 00:17:01.737 21:17:56 -- common/autotest_common.sh@936 -- # '[' -z 1319566 ']' 00:17:01.737 21:17:56 -- common/autotest_common.sh@940 -- # kill -0 1319566 00:17:01.996 21:17:56 -- common/autotest_common.sh@941 -- # uname 00:17:01.996 21:17:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:01.996 21:17:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1319566 00:17:01.996 21:17:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:01.996 21:17:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:01.996 21:17:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1319566' 00:17:01.996 killing process with pid 1319566 00:17:01.996 21:17:56 -- common/autotest_common.sh@955 -- # kill 1319566 00:17:01.996 21:17:56 -- common/autotest_common.sh@960 -- # wait 1319566 00:17:01.996 [2024-04-23 21:17:56.133439] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:02.255 21:17:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:02.255 21:17:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:02.255 00:17:02.255 real 0m11.146s 00:17:02.255 user 0m23.012s 00:17:02.255 sys 0m4.648s 00:17:02.255 21:17:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:02.255 21:17:56 -- common/autotest_common.sh@10 -- # set +x 00:17:02.255 ************************************ 00:17:02.255 END TEST nvmf_nvme_cli 00:17:02.255 ************************************ 00:17:02.255 21:17:56 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:17:02.255 21:17:56 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:17:02.255 21:17:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:02.255 21:17:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:02.255 21:17:56 -- common/autotest_common.sh@10 -- # set +x 00:17:02.518 ************************************ 00:17:02.518 START TEST nvmf_host_management 00:17:02.518 ************************************ 00:17:02.518 21:17:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:17:02.518 * Looking for test storage... 00:17:02.518 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:02.518 21:17:56 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:02.518 21:17:56 -- nvmf/common.sh@7 -- # uname -s 00:17:02.518 21:17:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:02.518 21:17:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:02.518 21:17:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:02.518 21:17:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:02.518 21:17:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:02.518 21:17:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:02.518 21:17:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:02.518 21:17:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:02.518 21:17:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:02.518 21:17:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:02.518 21:17:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:02.518 21:17:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:02.518 21:17:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:02.518 21:17:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:02.518 21:17:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:02.518 21:17:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:02.518 21:17:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:02.518 21:17:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:02.518 21:17:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:02.518 21:17:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:02.518 21:17:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.518 21:17:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.518 21:17:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.518 21:17:56 -- paths/export.sh@5 -- # export PATH 00:17:02.518 21:17:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.518 21:17:56 -- nvmf/common.sh@47 -- # : 0 00:17:02.518 21:17:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:02.518 21:17:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:02.518 21:17:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:02.518 21:17:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:02.518 21:17:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:02.518 21:17:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:02.518 21:17:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:02.518 21:17:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:02.518 21:17:56 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:02.518 21:17:56 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:02.518 21:17:56 -- target/host_management.sh@105 -- # nvmftestinit 00:17:02.518 21:17:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:02.518 21:17:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:02.518 21:17:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:02.519 21:17:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:02.519 21:17:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:02.519 21:17:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.519 21:17:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.519 21:17:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.519 21:17:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:02.519 21:17:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:02.519 21:17:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:02.519 21:17:56 -- common/autotest_common.sh@10 -- # set +x 00:17:07.790 21:18:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:07.790 21:18:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:07.790 21:18:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:07.790 21:18:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:07.790 21:18:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:07.790 21:18:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:07.790 21:18:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:07.790 21:18:01 -- nvmf/common.sh@295 -- # net_devs=() 00:17:07.790 21:18:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:07.790 21:18:01 -- nvmf/common.sh@296 -- # e810=() 00:17:07.790 21:18:01 -- nvmf/common.sh@296 -- # local -ga e810 00:17:07.790 21:18:01 -- nvmf/common.sh@297 -- # x722=() 00:17:07.790 21:18:01 -- nvmf/common.sh@297 -- # local -ga x722 00:17:07.790 21:18:01 -- nvmf/common.sh@298 -- # mlx=() 00:17:07.790 21:18:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:07.790 21:18:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:07.790 21:18:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:07.790 21:18:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:07.790 21:18:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:07.790 21:18:01 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:07.790 21:18:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:07.790 21:18:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:07.790 21:18:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:07.790 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:07.790 21:18:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:07.790 21:18:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:07.791 21:18:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:07.791 21:18:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:07.791 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:07.791 21:18:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:07.791 21:18:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:07.791 21:18:01 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:07.791 21:18:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.791 21:18:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:07.791 21:18:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.791 21:18:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:07.791 Found net devices under 0000:18:00.0: mlx_0_0 00:17:07.791 21:18:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.791 21:18:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:07.791 21:18:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.791 21:18:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:07.791 21:18:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.791 21:18:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:07.791 Found net devices under 0000:18:00.1: mlx_0_1 00:17:07.791 21:18:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.791 21:18:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:07.791 21:18:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:07.791 21:18:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:07.791 21:18:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:07.791 21:18:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:07.791 21:18:01 -- nvmf/common.sh@58 -- # uname 00:17:07.791 21:18:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:07.791 21:18:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:07.791 21:18:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:07.791 21:18:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:07.791 21:18:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:07.791 21:18:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:07.791 21:18:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:07.791 21:18:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:07.791 21:18:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:07.791 21:18:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:07.791 21:18:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:07.791 21:18:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:07.791 21:18:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:07.791 21:18:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:07.791 21:18:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:07.791 21:18:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:07.791 21:18:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.791 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.791 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:07.791 21:18:02 -- nvmf/common.sh@105 -- # continue 2 00:17:07.791 21:18:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:07.791 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.791 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:07.791 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:07.791 21:18:02 -- nvmf/common.sh@105 -- # continue 2 00:17:07.791 21:18:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:07.791 21:18:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:07.791 21:18:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.791 21:18:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:07.791 21:18:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:07.791 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:07.791 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:07.791 altname enp24s0f0np0 00:17:07.791 altname ens785f0np0 00:17:07.791 inet 192.168.100.8/24 scope global mlx_0_0 00:17:07.791 valid_lft forever preferred_lft forever 00:17:07.791 21:18:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:07.791 21:18:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:07.791 21:18:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:07.791 21:18:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:07.791 21:18:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:07.791 21:18:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:07.791 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:07.791 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:07.791 altname enp24s0f1np1 00:17:07.791 altname ens785f1np1 00:17:07.791 inet 192.168.100.9/24 scope global mlx_0_1 00:17:07.791 valid_lft forever preferred_lft forever 00:17:07.791 21:18:02 -- nvmf/common.sh@411 -- # return 0 00:17:07.791 21:18:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:07.791 21:18:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:07.791 21:18:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:07.791 21:18:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:07.791 21:18:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:07.791 21:18:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:07.791 21:18:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:08.050 21:18:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:08.050 21:18:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:08.050 21:18:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:08.050 21:18:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:08.050 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:08.050 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:08.050 21:18:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:08.050 21:18:02 -- nvmf/common.sh@105 -- # continue 2 00:17:08.050 21:18:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:08.050 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:08.050 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:08.050 21:18:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:08.050 21:18:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:08.050 21:18:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:08.050 21:18:02 -- nvmf/common.sh@105 -- # continue 2 00:17:08.050 21:18:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:08.050 21:18:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:08.050 21:18:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:08.050 21:18:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:08.050 21:18:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:08.050 21:18:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:08.051 21:18:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:08.051 21:18:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:08.051 21:18:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:08.051 21:18:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:08.051 21:18:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:08.051 21:18:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:08.051 21:18:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:08.051 192.168.100.9' 00:17:08.051 21:18:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:08.051 192.168.100.9' 00:17:08.051 21:18:02 -- nvmf/common.sh@446 -- # head -n 1 00:17:08.051 21:18:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:08.051 21:18:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:08.051 192.168.100.9' 00:17:08.051 21:18:02 -- nvmf/common.sh@447 -- # tail -n +2 00:17:08.051 21:18:02 -- nvmf/common.sh@447 -- # head -n 1 00:17:08.051 21:18:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:08.051 21:18:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:08.051 21:18:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:08.051 21:18:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:08.051 21:18:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:08.051 21:18:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:08.051 21:18:02 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:17:08.051 21:18:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:08.051 21:18:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.051 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:17:08.051 ************************************ 00:17:08.051 START TEST nvmf_host_management 00:17:08.051 ************************************ 00:17:08.051 21:18:02 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:17:08.051 21:18:02 -- target/host_management.sh@69 -- # starttarget 00:17:08.051 21:18:02 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:08.051 21:18:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:08.051 21:18:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:08.051 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:17:08.051 21:18:02 -- nvmf/common.sh@470 -- # nvmfpid=1323984 00:17:08.051 21:18:02 -- nvmf/common.sh@471 -- # waitforlisten 1323984 00:17:08.051 21:18:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:08.051 21:18:02 -- common/autotest_common.sh@817 -- # '[' -z 1323984 ']' 00:17:08.051 21:18:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.051 21:18:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:08.051 21:18:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.051 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.051 21:18:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:08.051 21:18:02 -- common/autotest_common.sh@10 -- # set +x 00:17:08.051 [2024-04-23 21:18:02.287010] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:08.051 [2024-04-23 21:18:02.287049] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:08.051 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.310 [2024-04-23 21:18:02.336181] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:08.310 [2024-04-23 21:18:02.408226] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.310 [2024-04-23 21:18:02.408261] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.310 [2024-04-23 21:18:02.408267] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:08.310 [2024-04-23 21:18:02.408272] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:08.310 [2024-04-23 21:18:02.408284] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.310 [2024-04-23 21:18:02.408328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:08.310 [2024-04-23 21:18:02.408345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:08.310 [2024-04-23 21:18:02.408457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.310 [2024-04-23 21:18:02.408460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:08.877 21:18:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:08.877 21:18:03 -- common/autotest_common.sh@850 -- # return 0 00:17:08.877 21:18:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:08.877 21:18:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:08.877 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:08.877 21:18:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.877 21:18:03 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:08.877 21:18:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:08.877 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:08.877 [2024-04-23 21:18:03.131568] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bfb9a0/0x1bffe90) succeed. 00:17:08.877 [2024-04-23 21:18:03.140775] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bfcfe0/0x1c41520) succeed. 00:17:09.135 21:18:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:09.135 21:18:03 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:09.135 21:18:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:09.135 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:09.135 21:18:03 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:09.135 21:18:03 -- target/host_management.sh@23 -- # cat 00:17:09.135 21:18:03 -- target/host_management.sh@30 -- # rpc_cmd 00:17:09.135 21:18:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:09.135 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:09.135 Malloc0 00:17:09.135 [2024-04-23 21:18:03.304121] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:09.135 21:18:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:09.135 21:18:03 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:09.135 21:18:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:09.135 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:09.135 21:18:03 -- target/host_management.sh@73 -- # perfpid=1324153 00:17:09.135 21:18:03 -- target/host_management.sh@74 -- # waitforlisten 1324153 /var/tmp/bdevperf.sock 00:17:09.135 21:18:03 -- common/autotest_common.sh@817 -- # '[' -z 1324153 ']' 00:17:09.135 21:18:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:09.135 21:18:03 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:09.135 21:18:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:09.135 21:18:03 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:09.135 21:18:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:09.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:09.135 21:18:03 -- nvmf/common.sh@521 -- # config=() 00:17:09.135 21:18:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:09.135 21:18:03 -- nvmf/common.sh@521 -- # local subsystem config 00:17:09.135 21:18:03 -- common/autotest_common.sh@10 -- # set +x 00:17:09.135 21:18:03 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:09.135 21:18:03 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:09.135 { 00:17:09.135 "params": { 00:17:09.135 "name": "Nvme$subsystem", 00:17:09.135 "trtype": "$TEST_TRANSPORT", 00:17:09.135 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:09.135 "adrfam": "ipv4", 00:17:09.135 "trsvcid": "$NVMF_PORT", 00:17:09.135 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:09.135 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:09.135 "hdgst": ${hdgst:-false}, 00:17:09.135 "ddgst": ${ddgst:-false} 00:17:09.135 }, 00:17:09.135 "method": "bdev_nvme_attach_controller" 00:17:09.135 } 00:17:09.135 EOF 00:17:09.135 )") 00:17:09.135 21:18:03 -- nvmf/common.sh@543 -- # cat 00:17:09.135 21:18:03 -- nvmf/common.sh@545 -- # jq . 00:17:09.135 21:18:03 -- nvmf/common.sh@546 -- # IFS=, 00:17:09.135 21:18:03 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:09.135 "params": { 00:17:09.135 "name": "Nvme0", 00:17:09.135 "trtype": "rdma", 00:17:09.135 "traddr": "192.168.100.8", 00:17:09.135 "adrfam": "ipv4", 00:17:09.135 "trsvcid": "4420", 00:17:09.135 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:09.135 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:09.135 "hdgst": false, 00:17:09.135 "ddgst": false 00:17:09.135 }, 00:17:09.135 "method": "bdev_nvme_attach_controller" 00:17:09.135 }' 00:17:09.135 [2024-04-23 21:18:03.390650] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:09.135 [2024-04-23 21:18:03.390691] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1324153 ] 00:17:09.394 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.394 [2024-04-23 21:18:03.441644] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:09.394 [2024-04-23 21:18:03.507515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:09.652 Running I/O for 10 seconds... 00:17:10.221 21:18:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:10.221 21:18:04 -- common/autotest_common.sh@850 -- # return 0 00:17:10.221 21:18:04 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:10.221 21:18:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.221 21:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:10.221 21:18:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:10.221 21:18:04 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:10.221 21:18:04 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:10.221 21:18:04 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:10.221 21:18:04 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:10.221 21:18:04 -- target/host_management.sh@52 -- # local ret=1 00:17:10.221 21:18:04 -- target/host_management.sh@53 -- # local i 00:17:10.221 21:18:04 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:10.221 21:18:04 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:10.221 21:18:04 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:10.221 21:18:04 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:10.221 21:18:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.221 21:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:10.221 21:18:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:10.221 21:18:04 -- target/host_management.sh@55 -- # read_io_count=1770 00:17:10.221 21:18:04 -- target/host_management.sh@58 -- # '[' 1770 -ge 100 ']' 00:17:10.221 21:18:04 -- target/host_management.sh@59 -- # ret=0 00:17:10.221 21:18:04 -- target/host_management.sh@60 -- # break 00:17:10.221 21:18:04 -- target/host_management.sh@64 -- # return 0 00:17:10.221 21:18:04 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:10.221 21:18:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.221 21:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:10.221 21:18:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:10.221 21:18:04 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:10.221 21:18:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:10.221 21:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:10.221 [2024-04-23 21:18:04.265482] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 8 00:17:10.221 21:18:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:10.221 21:18:04 -- target/host_management.sh@87 -- # sleep 1 00:17:11.189 [2024-04-23 21:18:05.267012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:111488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018edff00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:111616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018ecfe80 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:111744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018ebfe00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:111872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018eafd80 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:112000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e9fd00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:112128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e8fc80 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:112256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e7fc00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:112384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e6fb80 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:112512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e5fb00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:112640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e4fa80 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:112768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e3fa00 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:112896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e2f980 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:113024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e1f900 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:113152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e0f880 len:0x10000 key:0x182600 00:17:11.189 [2024-04-23 21:18:05.267310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:113280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a4b040 len:0x10000 key:0x182100 00:17:11.189 [2024-04-23 21:18:05.267328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:113408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a3afc0 len:0x10000 key:0x182100 00:17:11.189 [2024-04-23 21:18:05.267348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:113536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a2af40 len:0x10000 key:0x182100 00:17:11.189 [2024-04-23 21:18:05.267368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:113664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a1aec0 len:0x10000 key:0x182100 00:17:11.189 [2024-04-23 21:18:05.267388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.189 [2024-04-23 21:18:05.267398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:113792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a0ae40 len:0x10000 key:0x182100 00:17:11.189 [2024-04-23 21:18:05.267408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:113920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003eef0c0 len:0x10000 key:0x182200 00:17:11.190 [2024-04-23 21:18:05.267431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:114048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003edf040 len:0x10000 key:0x182200 00:17:11.190 [2024-04-23 21:18:05.267451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:114176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003ecefc0 len:0x10000 key:0x182200 00:17:11.190 [2024-04-23 21:18:05.267471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:114304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003ebef40 len:0x10000 key:0x182200 00:17:11.190 [2024-04-23 21:18:05.267491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:114432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003eaeec0 len:0x10000 key:0x182200 00:17:11.190 [2024-04-23 21:18:05.267510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:114560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ea980 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:111360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000edc0000 len:0x10000 key:0x182400 00:17:11.190 [2024-04-23 21:18:05.267549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:114688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:114816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:114944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:115072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:115200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:115328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:115456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:115584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:115712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:115840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:115968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:116096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:116224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:17:11.190 [2024-04-23 21:18:05.267830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001928d400 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:116608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001927d380 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:116736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001926d300 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:116864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001925d280 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:116992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001924d200 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:117120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001923d180 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:117248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001922d100 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.267983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:117376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001921d080 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.267992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:117504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001920d000 len:0x10000 key:0x182800 00:17:11.190 [2024-04-23 21:18:05.268012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:117632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:17:11.190 [2024-04-23 21:18:05.268032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:117760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:17:11.190 [2024-04-23 21:18:05.268052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:117888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:17:11.190 [2024-04-23 21:18:05.268072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:118016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:17:11.190 [2024-04-23 21:18:05.268095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:17:11.190 [2024-04-23 21:18:05.268115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.190 [2024-04-23 21:18:05.268125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:118272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:118528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:118656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:118784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:118912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:119040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:119168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001902f980 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:119296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001901f900 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.268313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:119424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001900f880 len:0x10000 key:0x182700 00:17:11.191 [2024-04-23 21:18:05.268328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:8d20 p:0 m:0 dnr:0 00:17:11.191 [2024-04-23 21:18:05.270298] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e5180 was disconnected and freed. reset controller. 00:17:11.191 [2024-04-23 21:18:05.271147] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:11.191 21:18:05 -- target/host_management.sh@91 -- # kill -9 1324153 00:17:11.191 21:18:05 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:11.191 21:18:05 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:11.191 21:18:05 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:11.191 21:18:05 -- nvmf/common.sh@521 -- # config=() 00:17:11.191 21:18:05 -- nvmf/common.sh@521 -- # local subsystem config 00:17:11.191 21:18:05 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:11.191 21:18:05 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:11.191 { 00:17:11.191 "params": { 00:17:11.191 "name": "Nvme$subsystem", 00:17:11.191 "trtype": "$TEST_TRANSPORT", 00:17:11.191 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:11.191 "adrfam": "ipv4", 00:17:11.191 "trsvcid": "$NVMF_PORT", 00:17:11.191 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:11.191 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:11.191 "hdgst": ${hdgst:-false}, 00:17:11.191 "ddgst": ${ddgst:-false} 00:17:11.191 }, 00:17:11.191 "method": "bdev_nvme_attach_controller" 00:17:11.191 } 00:17:11.191 EOF 00:17:11.191 )") 00:17:11.191 21:18:05 -- nvmf/common.sh@543 -- # cat 00:17:11.191 21:18:05 -- nvmf/common.sh@545 -- # jq . 00:17:11.191 21:18:05 -- nvmf/common.sh@546 -- # IFS=, 00:17:11.191 21:18:05 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:11.191 "params": { 00:17:11.191 "name": "Nvme0", 00:17:11.191 "trtype": "rdma", 00:17:11.191 "traddr": "192.168.100.8", 00:17:11.191 "adrfam": "ipv4", 00:17:11.191 "trsvcid": "4420", 00:17:11.191 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:11.191 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:11.191 "hdgst": false, 00:17:11.191 "ddgst": false 00:17:11.191 }, 00:17:11.191 "method": "bdev_nvme_attach_controller" 00:17:11.191 }' 00:17:11.191 [2024-04-23 21:18:05.318923] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:11.191 [2024-04-23 21:18:05.318974] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1324915 ] 00:17:11.191 EAL: No free 2048 kB hugepages reported on node 1 00:17:11.191 [2024-04-23 21:18:05.370564] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:11.191 [2024-04-23 21:18:05.436211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:11.451 Running I/O for 1 seconds... 00:17:12.387 00:17:12.387 Latency(us) 00:17:12.387 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:12.387 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:12.387 Verification LBA range: start 0x0 length 0x400 00:17:12.387 Nvme0n1 : 1.01 3331.75 208.23 0.00 0.00 18830.13 397.46 30874.74 00:17:12.387 =================================================================================================================== 00:17:12.387 Total : 3331.75 208.23 0.00 0.00 18830.13 397.46 30874.74 00:17:12.646 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 1324153 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:17:12.646 21:18:06 -- target/host_management.sh@102 -- # stoptarget 00:17:12.646 21:18:06 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:12.646 21:18:06 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:12.646 21:18:06 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:12.646 21:18:06 -- target/host_management.sh@40 -- # nvmftestfini 00:17:12.646 21:18:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:12.646 21:18:06 -- nvmf/common.sh@117 -- # sync 00:17:12.646 21:18:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:12.646 21:18:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:12.646 21:18:06 -- nvmf/common.sh@120 -- # set +e 00:17:12.646 21:18:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:12.646 21:18:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:12.646 rmmod nvme_rdma 00:17:12.646 rmmod nvme_fabrics 00:17:12.646 21:18:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:12.646 21:18:06 -- nvmf/common.sh@124 -- # set -e 00:17:12.646 21:18:06 -- nvmf/common.sh@125 -- # return 0 00:17:12.646 21:18:06 -- nvmf/common.sh@478 -- # '[' -n 1323984 ']' 00:17:12.646 21:18:06 -- nvmf/common.sh@479 -- # killprocess 1323984 00:17:12.646 21:18:06 -- common/autotest_common.sh@936 -- # '[' -z 1323984 ']' 00:17:12.646 21:18:06 -- common/autotest_common.sh@940 -- # kill -0 1323984 00:17:12.646 21:18:06 -- common/autotest_common.sh@941 -- # uname 00:17:12.646 21:18:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:12.646 21:18:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1323984 00:17:12.905 21:18:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:12.905 21:18:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:12.905 21:18:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1323984' 00:17:12.905 killing process with pid 1323984 00:17:12.905 21:18:06 -- common/autotest_common.sh@955 -- # kill 1323984 00:17:12.905 21:18:06 -- common/autotest_common.sh@960 -- # wait 1323984 00:17:12.905 [2024-04-23 21:18:07.025728] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:13.164 [2024-04-23 21:18:07.218101] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:13.164 21:18:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:13.164 21:18:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:13.164 00:17:13.164 real 0m5.001s 00:17:13.164 user 0m22.562s 00:17:13.164 sys 0m0.804s 00:17:13.164 21:18:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:13.164 21:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:13.164 ************************************ 00:17:13.164 END TEST nvmf_host_management 00:17:13.164 ************************************ 00:17:13.164 21:18:07 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:17:13.164 00:17:13.164 real 0m10.744s 00:17:13.164 user 0m24.260s 00:17:13.164 sys 0m4.987s 00:17:13.164 21:18:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:13.164 21:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:13.164 ************************************ 00:17:13.164 END TEST nvmf_host_management 00:17:13.164 ************************************ 00:17:13.164 21:18:07 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:13.164 21:18:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:13.164 21:18:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.164 21:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:13.164 ************************************ 00:17:13.164 START TEST nvmf_lvol 00:17:13.164 ************************************ 00:17:13.164 21:18:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:13.423 * Looking for test storage... 00:17:13.423 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:13.423 21:18:07 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:13.423 21:18:07 -- nvmf/common.sh@7 -- # uname -s 00:17:13.423 21:18:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:13.423 21:18:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:13.423 21:18:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:13.423 21:18:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:13.423 21:18:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:13.423 21:18:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:13.423 21:18:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:13.423 21:18:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:13.423 21:18:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:13.423 21:18:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:13.423 21:18:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:13.423 21:18:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:13.423 21:18:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:13.423 21:18:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:13.423 21:18:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:13.423 21:18:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:13.423 21:18:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:13.423 21:18:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:13.423 21:18:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:13.423 21:18:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:13.423 21:18:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.423 21:18:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.423 21:18:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.423 21:18:07 -- paths/export.sh@5 -- # export PATH 00:17:13.423 21:18:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.423 21:18:07 -- nvmf/common.sh@47 -- # : 0 00:17:13.423 21:18:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:13.423 21:18:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:13.423 21:18:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:13.423 21:18:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:13.423 21:18:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:13.423 21:18:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:13.423 21:18:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:13.423 21:18:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:13.423 21:18:07 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:13.423 21:18:07 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:13.423 21:18:07 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:13.424 21:18:07 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:13.424 21:18:07 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:13.424 21:18:07 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:13.424 21:18:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:13.424 21:18:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:13.424 21:18:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:13.424 21:18:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:13.424 21:18:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:13.424 21:18:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.424 21:18:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.424 21:18:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.424 21:18:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:13.424 21:18:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:13.424 21:18:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:13.424 21:18:07 -- common/autotest_common.sh@10 -- # set +x 00:17:18.705 21:18:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:18.705 21:18:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:18.705 21:18:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:18.705 21:18:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:18.705 21:18:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:18.705 21:18:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:18.705 21:18:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:18.705 21:18:12 -- nvmf/common.sh@295 -- # net_devs=() 00:17:18.705 21:18:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:18.705 21:18:12 -- nvmf/common.sh@296 -- # e810=() 00:17:18.705 21:18:12 -- nvmf/common.sh@296 -- # local -ga e810 00:17:18.705 21:18:12 -- nvmf/common.sh@297 -- # x722=() 00:17:18.705 21:18:12 -- nvmf/common.sh@297 -- # local -ga x722 00:17:18.705 21:18:12 -- nvmf/common.sh@298 -- # mlx=() 00:17:18.705 21:18:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:18.705 21:18:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:18.705 21:18:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:18.705 21:18:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:18.705 21:18:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:18.705 21:18:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:18.705 21:18:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:18.705 21:18:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:18.705 21:18:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:18.705 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:18.705 21:18:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:18.705 21:18:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:18.705 21:18:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:18.705 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:18.705 21:18:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:18.705 21:18:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:18.705 21:18:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:18.705 21:18:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:18.706 21:18:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:18.706 21:18:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.706 21:18:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:18.706 21:18:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.706 21:18:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:18.706 Found net devices under 0000:18:00.0: mlx_0_0 00:17:18.706 21:18:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.706 21:18:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:18.706 21:18:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:18.706 21:18:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:18.706 21:18:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:18.706 21:18:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:18.706 Found net devices under 0000:18:00.1: mlx_0_1 00:17:18.706 21:18:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:18.706 21:18:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:18.706 21:18:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:18.706 21:18:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:18.706 21:18:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:18.706 21:18:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:18.706 21:18:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:18.706 21:18:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:18.706 21:18:12 -- nvmf/common.sh@58 -- # uname 00:17:18.706 21:18:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:18.706 21:18:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:18.706 21:18:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:18.706 21:18:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:18.706 21:18:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:18.706 21:18:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:18.706 21:18:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:18.706 21:18:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:18.706 21:18:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:18.706 21:18:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:18.706 21:18:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:18.706 21:18:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:18.706 21:18:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:18.706 21:18:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:18.707 21:18:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:18.707 21:18:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:18.707 21:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:18.707 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.707 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:18.707 21:18:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:18.707 21:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:18.707 21:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:18.707 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.707 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:18.707 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.707 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:18.707 21:18:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:18.707 21:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:18.707 21:18:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:18.707 21:18:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:18.707 21:18:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:18.707 21:18:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:18.707 21:18:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:18.707 21:18:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:18.707 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:18.707 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:18.707 altname enp24s0f0np0 00:17:18.707 altname ens785f0np0 00:17:18.707 inet 192.168.100.8/24 scope global mlx_0_0 00:17:18.707 valid_lft forever preferred_lft forever 00:17:18.707 21:18:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:18.707 21:18:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:18.707 21:18:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:18.707 21:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:18.708 21:18:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:18.708 21:18:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:18.708 21:18:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:18.708 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:18.708 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:18.708 altname enp24s0f1np1 00:17:18.708 altname ens785f1np1 00:17:18.708 inet 192.168.100.9/24 scope global mlx_0_1 00:17:18.708 valid_lft forever preferred_lft forever 00:17:18.708 21:18:12 -- nvmf/common.sh@411 -- # return 0 00:17:18.708 21:18:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:18.708 21:18:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:18.708 21:18:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:18.708 21:18:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:18.708 21:18:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:18.708 21:18:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:18.708 21:18:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:18.708 21:18:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:18.708 21:18:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:18.708 21:18:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:18.708 21:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:18.708 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.708 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:18.708 21:18:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:18.708 21:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:18.708 21:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:18.708 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.708 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:18.709 21:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:18.709 21:18:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:18.709 21:18:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:18.709 21:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:18.709 21:18:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:18.709 21:18:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:18.709 21:18:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:18.709 21:18:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:18.709 21:18:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:18.709 21:18:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:18.709 21:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:18.709 21:18:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:18.709 192.168.100.9' 00:17:18.709 21:18:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:18.709 192.168.100.9' 00:17:18.709 21:18:12 -- nvmf/common.sh@446 -- # head -n 1 00:17:18.710 21:18:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:18.710 21:18:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:18.710 192.168.100.9' 00:17:18.710 21:18:12 -- nvmf/common.sh@447 -- # tail -n +2 00:17:18.710 21:18:12 -- nvmf/common.sh@447 -- # head -n 1 00:17:18.710 21:18:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:18.710 21:18:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:18.710 21:18:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:18.710 21:18:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:18.710 21:18:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:18.710 21:18:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:18.710 21:18:12 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:18.710 21:18:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:18.710 21:18:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:18.710 21:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:18.710 21:18:12 -- nvmf/common.sh@470 -- # nvmfpid=1328773 00:17:18.710 21:18:12 -- nvmf/common.sh@471 -- # waitforlisten 1328773 00:17:18.710 21:18:12 -- common/autotest_common.sh@817 -- # '[' -z 1328773 ']' 00:17:18.710 21:18:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:18.710 21:18:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:18.710 21:18:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:18.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:18.710 21:18:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:18.710 21:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:18.710 21:18:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:18.710 [2024-04-23 21:18:12.861531] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:18.710 [2024-04-23 21:18:12.861571] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:18.710 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.710 [2024-04-23 21:18:12.911010] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:18.977 [2024-04-23 21:18:12.981867] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:18.977 [2024-04-23 21:18:12.981899] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:18.977 [2024-04-23 21:18:12.981908] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:18.977 [2024-04-23 21:18:12.981915] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:18.977 [2024-04-23 21:18:12.981920] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:18.977 [2024-04-23 21:18:12.981960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:18.977 [2024-04-23 21:18:12.982051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:18.977 [2024-04-23 21:18:12.982052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:19.543 21:18:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:19.543 21:18:13 -- common/autotest_common.sh@850 -- # return 0 00:17:19.543 21:18:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:19.543 21:18:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:19.543 21:18:13 -- common/autotest_common.sh@10 -- # set +x 00:17:19.543 21:18:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:19.543 21:18:13 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:19.801 [2024-04-23 21:18:13.819047] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xdd6bd0/0xddb0c0) succeed. 00:17:19.801 [2024-04-23 21:18:13.827961] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xdd8170/0xe1c750) succeed. 00:17:19.801 21:18:13 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:20.058 21:18:14 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:20.058 21:18:14 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:20.058 21:18:14 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:20.059 21:18:14 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:20.316 21:18:14 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:20.574 21:18:14 -- target/nvmf_lvol.sh@29 -- # lvs=3f8eabc9-fd65-4288-9cb8-a0345b54a211 00:17:20.574 21:18:14 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 3f8eabc9-fd65-4288-9cb8-a0345b54a211 lvol 20 00:17:20.574 21:18:14 -- target/nvmf_lvol.sh@32 -- # lvol=73d579fc-60e4-44bb-bd9e-69dbb445f9e1 00:17:20.574 21:18:14 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:20.833 21:18:14 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 73d579fc-60e4-44bb-bd9e-69dbb445f9e1 00:17:21.091 21:18:15 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:21.091 [2024-04-23 21:18:15.274495] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:21.091 21:18:15 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:21.350 21:18:15 -- target/nvmf_lvol.sh@42 -- # perf_pid=1329225 00:17:21.350 21:18:15 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:21.350 21:18:15 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:21.350 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.286 21:18:16 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 73d579fc-60e4-44bb-bd9e-69dbb445f9e1 MY_SNAPSHOT 00:17:22.544 21:18:16 -- target/nvmf_lvol.sh@47 -- # snapshot=1565bd9a-da04-4317-96d9-1855e3eead04 00:17:22.545 21:18:16 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 73d579fc-60e4-44bb-bd9e-69dbb445f9e1 30 00:17:22.803 21:18:16 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 1565bd9a-da04-4317-96d9-1855e3eead04 MY_CLONE 00:17:22.803 21:18:17 -- target/nvmf_lvol.sh@49 -- # clone=89bdbf14-a79b-4f06-97d8-df15746d4b06 00:17:22.804 21:18:17 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 89bdbf14-a79b-4f06-97d8-df15746d4b06 00:17:23.062 21:18:17 -- target/nvmf_lvol.sh@53 -- # wait 1329225 00:17:33.033 Initializing NVMe Controllers 00:17:33.033 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:17:33.033 Controller IO queue size 128, less than required. 00:17:33.033 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:33.033 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:33.033 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:33.033 Initialization complete. Launching workers. 00:17:33.033 ======================================================== 00:17:33.033 Latency(us) 00:17:33.033 Device Information : IOPS MiB/s Average min max 00:17:33.033 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 18135.00 70.84 7059.82 2007.99 37082.42 00:17:33.033 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 18101.10 70.71 7072.56 3438.50 33002.94 00:17:33.033 ======================================================== 00:17:33.033 Total : 36236.10 141.55 7066.18 2007.99 37082.42 00:17:33.033 00:17:33.033 21:18:26 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:33.033 21:18:27 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 73d579fc-60e4-44bb-bd9e-69dbb445f9e1 00:17:33.033 21:18:27 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 3f8eabc9-fd65-4288-9cb8-a0345b54a211 00:17:33.292 21:18:27 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:33.292 21:18:27 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:33.292 21:18:27 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:33.292 21:18:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:33.292 21:18:27 -- nvmf/common.sh@117 -- # sync 00:17:33.292 21:18:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:33.292 21:18:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:33.292 21:18:27 -- nvmf/common.sh@120 -- # set +e 00:17:33.292 21:18:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:33.292 21:18:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:33.292 rmmod nvme_rdma 00:17:33.292 rmmod nvme_fabrics 00:17:33.292 21:18:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:33.292 21:18:27 -- nvmf/common.sh@124 -- # set -e 00:17:33.292 21:18:27 -- nvmf/common.sh@125 -- # return 0 00:17:33.292 21:18:27 -- nvmf/common.sh@478 -- # '[' -n 1328773 ']' 00:17:33.292 21:18:27 -- nvmf/common.sh@479 -- # killprocess 1328773 00:17:33.292 21:18:27 -- common/autotest_common.sh@936 -- # '[' -z 1328773 ']' 00:17:33.292 21:18:27 -- common/autotest_common.sh@940 -- # kill -0 1328773 00:17:33.292 21:18:27 -- common/autotest_common.sh@941 -- # uname 00:17:33.292 21:18:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:33.292 21:18:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1328773 00:17:33.292 21:18:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:33.292 21:18:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:33.292 21:18:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1328773' 00:17:33.292 killing process with pid 1328773 00:17:33.292 21:18:27 -- common/autotest_common.sh@955 -- # kill 1328773 00:17:33.292 21:18:27 -- common/autotest_common.sh@960 -- # wait 1328773 00:17:33.292 [2024-04-23 21:18:27.502280] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:33.551 21:18:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:33.551 21:18:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:33.551 00:17:33.551 real 0m20.327s 00:17:33.551 user 1m9.988s 00:17:33.551 sys 0m5.015s 00:17:33.551 21:18:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:33.551 21:18:27 -- common/autotest_common.sh@10 -- # set +x 00:17:33.551 ************************************ 00:17:33.551 END TEST nvmf_lvol 00:17:33.551 ************************************ 00:17:33.551 21:18:27 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:33.551 21:18:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:33.551 21:18:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:33.551 21:18:27 -- common/autotest_common.sh@10 -- # set +x 00:17:33.810 ************************************ 00:17:33.810 START TEST nvmf_lvs_grow 00:17:33.810 ************************************ 00:17:33.810 21:18:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:33.810 * Looking for test storage... 00:17:33.810 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:33.810 21:18:27 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:33.810 21:18:27 -- nvmf/common.sh@7 -- # uname -s 00:17:33.810 21:18:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:33.810 21:18:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:33.810 21:18:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:33.810 21:18:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:33.810 21:18:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:33.810 21:18:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:33.810 21:18:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:33.810 21:18:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:33.810 21:18:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:33.810 21:18:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:33.810 21:18:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:33.810 21:18:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:33.810 21:18:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:33.810 21:18:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:33.810 21:18:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:33.810 21:18:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:33.810 21:18:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:33.810 21:18:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:33.810 21:18:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:33.810 21:18:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:33.810 21:18:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.810 21:18:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.810 21:18:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.810 21:18:28 -- paths/export.sh@5 -- # export PATH 00:17:33.810 21:18:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:33.810 21:18:28 -- nvmf/common.sh@47 -- # : 0 00:17:33.810 21:18:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:33.810 21:18:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:33.810 21:18:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:33.810 21:18:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:33.810 21:18:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:33.810 21:18:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:33.810 21:18:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:33.810 21:18:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:33.810 21:18:28 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:33.810 21:18:28 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:33.810 21:18:28 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:33.810 21:18:28 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:33.810 21:18:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:33.810 21:18:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:33.810 21:18:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:33.810 21:18:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:33.810 21:18:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:33.810 21:18:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:33.810 21:18:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:33.810 21:18:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:33.810 21:18:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:33.810 21:18:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:33.810 21:18:28 -- common/autotest_common.sh@10 -- # set +x 00:17:39.118 21:18:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:39.118 21:18:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:39.118 21:18:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:39.118 21:18:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:39.118 21:18:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:39.118 21:18:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:39.118 21:18:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:39.118 21:18:33 -- nvmf/common.sh@295 -- # net_devs=() 00:17:39.118 21:18:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:39.118 21:18:33 -- nvmf/common.sh@296 -- # e810=() 00:17:39.118 21:18:33 -- nvmf/common.sh@296 -- # local -ga e810 00:17:39.118 21:18:33 -- nvmf/common.sh@297 -- # x722=() 00:17:39.118 21:18:33 -- nvmf/common.sh@297 -- # local -ga x722 00:17:39.118 21:18:33 -- nvmf/common.sh@298 -- # mlx=() 00:17:39.118 21:18:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:39.118 21:18:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:39.118 21:18:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:39.118 21:18:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:39.118 21:18:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:39.118 21:18:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:39.118 21:18:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:39.118 21:18:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:39.118 21:18:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:39.118 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:39.118 21:18:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:39.118 21:18:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:39.119 21:18:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:39.119 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:39.119 21:18:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:39.119 21:18:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:39.119 21:18:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:39.119 21:18:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:39.119 Found net devices under 0000:18:00.0: mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:39.119 21:18:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:39.119 21:18:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:39.119 21:18:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:39.119 Found net devices under 0000:18:00.1: mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:39.119 21:18:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:39.119 21:18:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:39.119 21:18:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:39.119 21:18:33 -- nvmf/common.sh@58 -- # uname 00:17:39.119 21:18:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:39.119 21:18:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:39.119 21:18:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:39.119 21:18:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:39.119 21:18:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:39.119 21:18:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:39.119 21:18:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:39.119 21:18:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:39.119 21:18:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:39.119 21:18:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:39.119 21:18:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:39.119 21:18:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:39.119 21:18:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:39.119 21:18:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:39.119 21:18:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:39.119 21:18:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@105 -- # continue 2 00:17:39.119 21:18:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@105 -- # continue 2 00:17:39.119 21:18:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:39.119 21:18:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:39.119 21:18:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:39.119 21:18:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:39.119 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:39.119 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:39.119 altname enp24s0f0np0 00:17:39.119 altname ens785f0np0 00:17:39.119 inet 192.168.100.8/24 scope global mlx_0_0 00:17:39.119 valid_lft forever preferred_lft forever 00:17:39.119 21:18:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:39.119 21:18:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:39.119 21:18:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:39.119 21:18:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:39.119 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:39.119 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:39.119 altname enp24s0f1np1 00:17:39.119 altname ens785f1np1 00:17:39.119 inet 192.168.100.9/24 scope global mlx_0_1 00:17:39.119 valid_lft forever preferred_lft forever 00:17:39.119 21:18:33 -- nvmf/common.sh@411 -- # return 0 00:17:39.119 21:18:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:39.119 21:18:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:39.119 21:18:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:39.119 21:18:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:39.119 21:18:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:39.119 21:18:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:39.119 21:18:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:39.119 21:18:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:39.119 21:18:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:39.119 21:18:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@105 -- # continue 2 00:17:39.119 21:18:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:39.119 21:18:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:39.119 21:18:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@105 -- # continue 2 00:17:39.119 21:18:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:39.119 21:18:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:39.119 21:18:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:39.119 21:18:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:39.119 21:18:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:39.119 21:18:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:39.119 192.168.100.9' 00:17:39.119 21:18:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:39.119 192.168.100.9' 00:17:39.119 21:18:33 -- nvmf/common.sh@446 -- # head -n 1 00:17:39.119 21:18:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:39.119 21:18:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:39.119 192.168.100.9' 00:17:39.119 21:18:33 -- nvmf/common.sh@447 -- # tail -n +2 00:17:39.119 21:18:33 -- nvmf/common.sh@447 -- # head -n 1 00:17:39.119 21:18:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:39.119 21:18:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:39.119 21:18:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:39.119 21:18:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:39.119 21:18:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:39.119 21:18:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:39.119 21:18:33 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:39.119 21:18:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:39.119 21:18:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:39.119 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:17:39.119 21:18:33 -- nvmf/common.sh@470 -- # nvmfpid=1334822 00:17:39.119 21:18:33 -- nvmf/common.sh@471 -- # waitforlisten 1334822 00:17:39.119 21:18:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:39.119 21:18:33 -- common/autotest_common.sh@817 -- # '[' -z 1334822 ']' 00:17:39.119 21:18:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:39.119 21:18:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:39.119 21:18:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:39.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:39.119 21:18:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:39.119 21:18:33 -- common/autotest_common.sh@10 -- # set +x 00:17:39.379 [2024-04-23 21:18:33.415767] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:39.379 [2024-04-23 21:18:33.415816] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:39.379 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.379 [2024-04-23 21:18:33.466919] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.379 [2024-04-23 21:18:33.538766] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:39.379 [2024-04-23 21:18:33.538801] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:39.379 [2024-04-23 21:18:33.538811] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:39.379 [2024-04-23 21:18:33.538816] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:39.379 [2024-04-23 21:18:33.538820] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:39.379 [2024-04-23 21:18:33.538859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:39.946 21:18:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:39.946 21:18:34 -- common/autotest_common.sh@850 -- # return 0 00:17:39.946 21:18:34 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:39.946 21:18:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:39.946 21:18:34 -- common/autotest_common.sh@10 -- # set +x 00:17:40.204 21:18:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:40.204 21:18:34 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:40.204 [2024-04-23 21:18:34.382688] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d69510/0x1d6da00) succeed. 00:17:40.204 [2024-04-23 21:18:34.390717] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d6aa10/0x1daf090) succeed. 00:17:40.204 21:18:34 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:40.204 21:18:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:40.204 21:18:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:40.204 21:18:34 -- common/autotest_common.sh@10 -- # set +x 00:17:40.463 ************************************ 00:17:40.463 START TEST lvs_grow_clean 00:17:40.463 ************************************ 00:17:40.463 21:18:34 -- common/autotest_common.sh@1111 -- # lvs_grow 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:40.463 21:18:34 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:40.722 21:18:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:40.722 21:18:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:40.722 21:18:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:40.722 21:18:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:40.722 21:18:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f31bd8e5-ebfd-4516-9573-333498499ae3 lvol 150 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@33 -- # lvol=60e9e8d1-ce15-4edf-9322-f9150320672a 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:40.981 21:18:35 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:41.318 [2024-04-23 21:18:35.371752] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:41.318 [2024-04-23 21:18:35.371799] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:41.318 true 00:17:41.318 21:18:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:41.319 21:18:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:41.319 21:18:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:41.319 21:18:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:41.578 21:18:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 60e9e8d1-ce15-4edf-9322-f9150320672a 00:17:41.836 21:18:35 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:41.836 [2024-04-23 21:18:35.977722] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:41.836 21:18:35 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:42.095 21:18:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1335331 00:17:42.095 21:18:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:42.095 21:18:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:42.095 21:18:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1335331 /var/tmp/bdevperf.sock 00:17:42.095 21:18:36 -- common/autotest_common.sh@817 -- # '[' -z 1335331 ']' 00:17:42.095 21:18:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:42.095 21:18:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:42.095 21:18:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:42.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:42.095 21:18:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:42.095 21:18:36 -- common/autotest_common.sh@10 -- # set +x 00:17:42.095 [2024-04-23 21:18:36.170012] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:42.095 [2024-04-23 21:18:36.170060] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1335331 ] 00:17:42.095 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.095 [2024-04-23 21:18:36.219677] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.095 [2024-04-23 21:18:36.290653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.029 21:18:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:43.029 21:18:36 -- common/autotest_common.sh@850 -- # return 0 00:17:43.029 21:18:36 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:43.029 Nvme0n1 00:17:43.029 21:18:37 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:43.288 [ 00:17:43.288 { 00:17:43.288 "name": "Nvme0n1", 00:17:43.288 "aliases": [ 00:17:43.288 "60e9e8d1-ce15-4edf-9322-f9150320672a" 00:17:43.288 ], 00:17:43.288 "product_name": "NVMe disk", 00:17:43.288 "block_size": 4096, 00:17:43.288 "num_blocks": 38912, 00:17:43.288 "uuid": "60e9e8d1-ce15-4edf-9322-f9150320672a", 00:17:43.288 "assigned_rate_limits": { 00:17:43.288 "rw_ios_per_sec": 0, 00:17:43.288 "rw_mbytes_per_sec": 0, 00:17:43.288 "r_mbytes_per_sec": 0, 00:17:43.288 "w_mbytes_per_sec": 0 00:17:43.288 }, 00:17:43.288 "claimed": false, 00:17:43.288 "zoned": false, 00:17:43.288 "supported_io_types": { 00:17:43.288 "read": true, 00:17:43.288 "write": true, 00:17:43.288 "unmap": true, 00:17:43.288 "write_zeroes": true, 00:17:43.288 "flush": true, 00:17:43.288 "reset": true, 00:17:43.288 "compare": true, 00:17:43.288 "compare_and_write": true, 00:17:43.288 "abort": true, 00:17:43.288 "nvme_admin": true, 00:17:43.288 "nvme_io": true 00:17:43.288 }, 00:17:43.288 "memory_domains": [ 00:17:43.288 { 00:17:43.288 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:43.288 "dma_device_type": 0 00:17:43.288 } 00:17:43.288 ], 00:17:43.288 "driver_specific": { 00:17:43.288 "nvme": [ 00:17:43.288 { 00:17:43.288 "trid": { 00:17:43.288 "trtype": "RDMA", 00:17:43.288 "adrfam": "IPv4", 00:17:43.288 "traddr": "192.168.100.8", 00:17:43.288 "trsvcid": "4420", 00:17:43.288 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:43.288 }, 00:17:43.288 "ctrlr_data": { 00:17:43.288 "cntlid": 1, 00:17:43.288 "vendor_id": "0x8086", 00:17:43.288 "model_number": "SPDK bdev Controller", 00:17:43.288 "serial_number": "SPDK0", 00:17:43.288 "firmware_revision": "24.05", 00:17:43.288 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:43.288 "oacs": { 00:17:43.288 "security": 0, 00:17:43.288 "format": 0, 00:17:43.288 "firmware": 0, 00:17:43.288 "ns_manage": 0 00:17:43.288 }, 00:17:43.288 "multi_ctrlr": true, 00:17:43.288 "ana_reporting": false 00:17:43.288 }, 00:17:43.288 "vs": { 00:17:43.288 "nvme_version": "1.3" 00:17:43.288 }, 00:17:43.288 "ns_data": { 00:17:43.288 "id": 1, 00:17:43.288 "can_share": true 00:17:43.288 } 00:17:43.288 } 00:17:43.288 ], 00:17:43.288 "mp_policy": "active_passive" 00:17:43.288 } 00:17:43.288 } 00:17:43.288 ] 00:17:43.288 21:18:37 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1335461 00:17:43.288 21:18:37 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:43.288 21:18:37 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:43.288 Running I/O for 10 seconds... 00:17:44.223 Latency(us) 00:17:44.223 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:44.223 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.223 Nvme0n1 : 1.00 38432.00 150.12 0.00 0.00 0.00 0.00 0.00 00:17:44.223 =================================================================================================================== 00:17:44.223 Total : 38432.00 150.12 0.00 0.00 0.00 0.00 0.00 00:17:44.223 00:17:45.158 21:18:39 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:45.416 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.416 Nvme0n1 : 2.00 38868.00 151.83 0.00 0.00 0.00 0.00 0.00 00:17:45.416 =================================================================================================================== 00:17:45.416 Total : 38868.00 151.83 0.00 0.00 0.00 0.00 0.00 00:17:45.416 00:17:45.416 true 00:17:45.416 21:18:39 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:45.416 21:18:39 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:45.416 21:18:39 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:45.416 21:18:39 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:45.416 21:18:39 -- target/nvmf_lvs_grow.sh@65 -- # wait 1335461 00:17:46.353 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.353 Nvme0n1 : 3.00 38857.33 151.79 0.00 0.00 0.00 0.00 0.00 00:17:46.353 =================================================================================================================== 00:17:46.353 Total : 38857.33 151.79 0.00 0.00 0.00 0.00 0.00 00:17:46.353 00:17:47.287 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.287 Nvme0n1 : 4.00 39006.75 152.37 0.00 0.00 0.00 0.00 0.00 00:17:47.287 =================================================================================================================== 00:17:47.287 Total : 39006.75 152.37 0.00 0.00 0.00 0.00 0.00 00:17:47.287 00:17:48.223 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.223 Nvme0n1 : 5.00 39122.40 152.82 0.00 0.00 0.00 0.00 0.00 00:17:48.223 =================================================================================================================== 00:17:48.223 Total : 39122.40 152.82 0.00 0.00 0.00 0.00 0.00 00:17:48.223 00:17:49.600 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.600 Nvme0n1 : 6.00 39200.83 153.13 0.00 0.00 0.00 0.00 0.00 00:17:49.600 =================================================================================================================== 00:17:49.600 Total : 39200.83 153.13 0.00 0.00 0.00 0.00 0.00 00:17:49.600 00:17:50.537 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:50.537 Nvme0n1 : 7.00 39277.14 153.43 0.00 0.00 0.00 0.00 0.00 00:17:50.537 =================================================================================================================== 00:17:50.537 Total : 39277.14 153.43 0.00 0.00 0.00 0.00 0.00 00:17:50.537 00:17:51.474 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:51.474 Nvme0n1 : 8.00 39319.62 153.59 0.00 0.00 0.00 0.00 0.00 00:17:51.474 =================================================================================================================== 00:17:51.474 Total : 39319.62 153.59 0.00 0.00 0.00 0.00 0.00 00:17:51.474 00:17:52.410 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:52.410 Nvme0n1 : 9.00 39350.11 153.71 0.00 0.00 0.00 0.00 0.00 00:17:52.410 =================================================================================================================== 00:17:52.410 Total : 39350.11 153.71 0.00 0.00 0.00 0.00 0.00 00:17:52.410 00:17:53.347 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.347 Nvme0n1 : 10.00 39279.60 153.44 0.00 0.00 0.00 0.00 0.00 00:17:53.347 =================================================================================================================== 00:17:53.347 Total : 39279.60 153.44 0.00 0.00 0.00 0.00 0.00 00:17:53.347 00:17:53.347 00:17:53.347 Latency(us) 00:17:53.347 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.347 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.347 Nvme0n1 : 10.00 39278.43 153.43 0.00 0.00 3256.27 1966.08 12039.21 00:17:53.347 =================================================================================================================== 00:17:53.347 Total : 39278.43 153.43 0.00 0.00 3256.27 1966.08 12039.21 00:17:53.347 0 00:17:53.347 21:18:47 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1335331 00:17:53.347 21:18:47 -- common/autotest_common.sh@936 -- # '[' -z 1335331 ']' 00:17:53.347 21:18:47 -- common/autotest_common.sh@940 -- # kill -0 1335331 00:17:53.347 21:18:47 -- common/autotest_common.sh@941 -- # uname 00:17:53.347 21:18:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:53.347 21:18:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1335331 00:17:53.347 21:18:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:53.347 21:18:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:53.347 21:18:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1335331' 00:17:53.347 killing process with pid 1335331 00:17:53.347 21:18:47 -- common/autotest_common.sh@955 -- # kill 1335331 00:17:53.347 Received shutdown signal, test time was about 10.000000 seconds 00:17:53.347 00:17:53.347 Latency(us) 00:17:53.347 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:53.348 =================================================================================================================== 00:17:53.348 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:53.348 21:18:47 -- common/autotest_common.sh@960 -- # wait 1335331 00:17:53.607 21:18:47 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:53.866 21:18:47 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:53.866 21:18:47 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:53.866 21:18:48 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:53.866 21:18:48 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:53.866 21:18:48 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:54.125 [2024-04-23 21:18:48.228566] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:54.125 21:18:48 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:54.125 21:18:48 -- common/autotest_common.sh@638 -- # local es=0 00:17:54.125 21:18:48 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:54.125 21:18:48 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:54.125 21:18:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:54.125 21:18:48 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:54.125 21:18:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:54.125 21:18:48 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:54.125 21:18:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:54.125 21:18:48 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:54.125 21:18:48 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:17:54.125 21:18:48 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:54.384 request: 00:17:54.384 { 00:17:54.384 "uuid": "f31bd8e5-ebfd-4516-9573-333498499ae3", 00:17:54.384 "method": "bdev_lvol_get_lvstores", 00:17:54.384 "req_id": 1 00:17:54.384 } 00:17:54.384 Got JSON-RPC error response 00:17:54.384 response: 00:17:54.384 { 00:17:54.384 "code": -19, 00:17:54.384 "message": "No such device" 00:17:54.384 } 00:17:54.384 21:18:48 -- common/autotest_common.sh@641 -- # es=1 00:17:54.384 21:18:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:54.384 21:18:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:54.384 21:18:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:54.384 21:18:48 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:54.384 aio_bdev 00:17:54.384 21:18:48 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 60e9e8d1-ce15-4edf-9322-f9150320672a 00:17:54.384 21:18:48 -- common/autotest_common.sh@885 -- # local bdev_name=60e9e8d1-ce15-4edf-9322-f9150320672a 00:17:54.384 21:18:48 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:17:54.384 21:18:48 -- common/autotest_common.sh@887 -- # local i 00:17:54.384 21:18:48 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:17:54.384 21:18:48 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:17:54.384 21:18:48 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:54.644 21:18:48 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 60e9e8d1-ce15-4edf-9322-f9150320672a -t 2000 00:17:54.644 [ 00:17:54.644 { 00:17:54.644 "name": "60e9e8d1-ce15-4edf-9322-f9150320672a", 00:17:54.644 "aliases": [ 00:17:54.644 "lvs/lvol" 00:17:54.644 ], 00:17:54.644 "product_name": "Logical Volume", 00:17:54.644 "block_size": 4096, 00:17:54.644 "num_blocks": 38912, 00:17:54.644 "uuid": "60e9e8d1-ce15-4edf-9322-f9150320672a", 00:17:54.644 "assigned_rate_limits": { 00:17:54.644 "rw_ios_per_sec": 0, 00:17:54.644 "rw_mbytes_per_sec": 0, 00:17:54.644 "r_mbytes_per_sec": 0, 00:17:54.644 "w_mbytes_per_sec": 0 00:17:54.644 }, 00:17:54.644 "claimed": false, 00:17:54.644 "zoned": false, 00:17:54.644 "supported_io_types": { 00:17:54.644 "read": true, 00:17:54.644 "write": true, 00:17:54.644 "unmap": true, 00:17:54.644 "write_zeroes": true, 00:17:54.644 "flush": false, 00:17:54.644 "reset": true, 00:17:54.644 "compare": false, 00:17:54.644 "compare_and_write": false, 00:17:54.644 "abort": false, 00:17:54.644 "nvme_admin": false, 00:17:54.644 "nvme_io": false 00:17:54.644 }, 00:17:54.644 "driver_specific": { 00:17:54.644 "lvol": { 00:17:54.644 "lvol_store_uuid": "f31bd8e5-ebfd-4516-9573-333498499ae3", 00:17:54.644 "base_bdev": "aio_bdev", 00:17:54.644 "thin_provision": false, 00:17:54.644 "snapshot": false, 00:17:54.644 "clone": false, 00:17:54.644 "esnap_clone": false 00:17:54.644 } 00:17:54.644 } 00:17:54.644 } 00:17:54.644 ] 00:17:54.644 21:18:48 -- common/autotest_common.sh@893 -- # return 0 00:17:54.644 21:18:48 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:54.644 21:18:48 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:54.902 21:18:49 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:54.902 21:18:49 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:54.902 21:18:49 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:55.161 21:18:49 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:55.161 21:18:49 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 60e9e8d1-ce15-4edf-9322-f9150320672a 00:17:55.161 21:18:49 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f31bd8e5-ebfd-4516-9573-333498499ae3 00:17:55.420 21:18:49 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:55.679 00:17:55.679 real 0m15.141s 00:17:55.679 user 0m15.248s 00:17:55.679 sys 0m0.922s 00:17:55.679 21:18:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:55.679 21:18:49 -- common/autotest_common.sh@10 -- # set +x 00:17:55.679 ************************************ 00:17:55.679 END TEST lvs_grow_clean 00:17:55.679 ************************************ 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:55.679 21:18:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:55.679 21:18:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:55.679 21:18:49 -- common/autotest_common.sh@10 -- # set +x 00:17:55.679 ************************************ 00:17:55.679 START TEST lvs_grow_dirty 00:17:55.679 ************************************ 00:17:55.679 21:18:49 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:55.679 21:18:49 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:55.943 21:18:50 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:55.943 21:18:50 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:56.202 21:18:50 -- target/nvmf_lvs_grow.sh@28 -- # lvs=089deb5d-e865-48a6-bbe1-63516152448e 00:17:56.203 21:18:50 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:17:56.203 21:18:50 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:56.203 21:18:50 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:56.203 21:18:50 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:56.203 21:18:50 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 089deb5d-e865-48a6-bbe1-63516152448e lvol 150 00:17:56.461 21:18:50 -- target/nvmf_lvs_grow.sh@33 -- # lvol=3a8594c2-84c0-4417-ab57-684dacba8c39 00:17:56.461 21:18:50 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:56.461 21:18:50 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:56.461 [2024-04-23 21:18:50.699370] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:56.461 [2024-04-23 21:18:50.699421] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:56.461 true 00:17:56.461 21:18:50 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:17:56.461 21:18:50 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:56.719 21:18:50 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:56.719 21:18:50 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:56.978 21:18:51 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3a8594c2-84c0-4417-ab57-684dacba8c39 00:17:56.978 21:18:51 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:57.236 21:18:51 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:57.236 21:18:51 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1338253 00:17:57.236 21:18:51 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:57.236 21:18:51 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:57.236 21:18:51 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1338253 /var/tmp/bdevperf.sock 00:17:57.236 21:18:51 -- common/autotest_common.sh@817 -- # '[' -z 1338253 ']' 00:17:57.236 21:18:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:57.236 21:18:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:57.236 21:18:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:57.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:57.236 21:18:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:57.236 21:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:57.236 [2024-04-23 21:18:51.497793] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:17:57.236 [2024-04-23 21:18:51.497836] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1338253 ] 00:17:57.494 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.494 [2024-04-23 21:18:51.547187] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.494 [2024-04-23 21:18:51.616432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:58.061 21:18:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:58.061 21:18:52 -- common/autotest_common.sh@850 -- # return 0 00:17:58.061 21:18:52 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:58.320 Nvme0n1 00:17:58.320 21:18:52 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:58.579 [ 00:17:58.579 { 00:17:58.579 "name": "Nvme0n1", 00:17:58.579 "aliases": [ 00:17:58.579 "3a8594c2-84c0-4417-ab57-684dacba8c39" 00:17:58.579 ], 00:17:58.579 "product_name": "NVMe disk", 00:17:58.579 "block_size": 4096, 00:17:58.579 "num_blocks": 38912, 00:17:58.579 "uuid": "3a8594c2-84c0-4417-ab57-684dacba8c39", 00:17:58.579 "assigned_rate_limits": { 00:17:58.579 "rw_ios_per_sec": 0, 00:17:58.579 "rw_mbytes_per_sec": 0, 00:17:58.579 "r_mbytes_per_sec": 0, 00:17:58.579 "w_mbytes_per_sec": 0 00:17:58.579 }, 00:17:58.579 "claimed": false, 00:17:58.579 "zoned": false, 00:17:58.579 "supported_io_types": { 00:17:58.579 "read": true, 00:17:58.579 "write": true, 00:17:58.579 "unmap": true, 00:17:58.579 "write_zeroes": true, 00:17:58.579 "flush": true, 00:17:58.579 "reset": true, 00:17:58.579 "compare": true, 00:17:58.579 "compare_and_write": true, 00:17:58.579 "abort": true, 00:17:58.579 "nvme_admin": true, 00:17:58.579 "nvme_io": true 00:17:58.579 }, 00:17:58.579 "memory_domains": [ 00:17:58.579 { 00:17:58.579 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:58.579 "dma_device_type": 0 00:17:58.579 } 00:17:58.579 ], 00:17:58.579 "driver_specific": { 00:17:58.579 "nvme": [ 00:17:58.579 { 00:17:58.579 "trid": { 00:17:58.579 "trtype": "RDMA", 00:17:58.579 "adrfam": "IPv4", 00:17:58.579 "traddr": "192.168.100.8", 00:17:58.579 "trsvcid": "4420", 00:17:58.579 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:58.579 }, 00:17:58.579 "ctrlr_data": { 00:17:58.579 "cntlid": 1, 00:17:58.579 "vendor_id": "0x8086", 00:17:58.579 "model_number": "SPDK bdev Controller", 00:17:58.579 "serial_number": "SPDK0", 00:17:58.579 "firmware_revision": "24.05", 00:17:58.579 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:58.579 "oacs": { 00:17:58.579 "security": 0, 00:17:58.579 "format": 0, 00:17:58.579 "firmware": 0, 00:17:58.579 "ns_manage": 0 00:17:58.579 }, 00:17:58.579 "multi_ctrlr": true, 00:17:58.579 "ana_reporting": false 00:17:58.579 }, 00:17:58.579 "vs": { 00:17:58.579 "nvme_version": "1.3" 00:17:58.579 }, 00:17:58.579 "ns_data": { 00:17:58.579 "id": 1, 00:17:58.579 "can_share": true 00:17:58.579 } 00:17:58.579 } 00:17:58.579 ], 00:17:58.579 "mp_policy": "active_passive" 00:17:58.579 } 00:17:58.579 } 00:17:58.579 ] 00:17:58.579 21:18:52 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1338520 00:17:58.579 21:18:52 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:58.579 21:18:52 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:58.579 Running I/O for 10 seconds... 00:17:59.516 Latency(us) 00:17:59.516 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.516 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.516 Nvme0n1 : 1.00 38747.00 151.36 0.00 0.00 0.00 0.00 0.00 00:17:59.516 =================================================================================================================== 00:17:59.516 Total : 38747.00 151.36 0.00 0.00 0.00 0.00 0.00 00:17:59.516 00:18:00.453 21:18:54 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:00.713 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.713 Nvme0n1 : 2.00 39085.50 152.68 0.00 0.00 0.00 0.00 0.00 00:18:00.713 =================================================================================================================== 00:18:00.713 Total : 39085.50 152.68 0.00 0.00 0.00 0.00 0.00 00:18:00.713 00:18:00.713 true 00:18:00.713 21:18:54 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:00.713 21:18:54 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:00.713 21:18:54 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:00.713 21:18:54 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:00.713 21:18:54 -- target/nvmf_lvs_grow.sh@65 -- # wait 1338520 00:18:01.650 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.650 Nvme0n1 : 3.00 39176.33 153.03 0.00 0.00 0.00 0.00 0.00 00:18:01.650 =================================================================================================================== 00:18:01.650 Total : 39176.33 153.03 0.00 0.00 0.00 0.00 0.00 00:18:01.650 00:18:02.587 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.587 Nvme0n1 : 4.00 39278.50 153.43 0.00 0.00 0.00 0.00 0.00 00:18:02.587 =================================================================================================================== 00:18:02.587 Total : 39278.50 153.43 0.00 0.00 0.00 0.00 0.00 00:18:02.587 00:18:03.523 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.523 Nvme0n1 : 5.00 39367.80 153.78 0.00 0.00 0.00 0.00 0.00 00:18:03.523 =================================================================================================================== 00:18:03.523 Total : 39367.80 153.78 0.00 0.00 0.00 0.00 0.00 00:18:03.523 00:18:04.898 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.898 Nvme0n1 : 6.00 39419.67 153.98 0.00 0.00 0.00 0.00 0.00 00:18:04.898 =================================================================================================================== 00:18:04.898 Total : 39419.67 153.98 0.00 0.00 0.00 0.00 0.00 00:18:04.898 00:18:05.832 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.832 Nvme0n1 : 7.00 39464.29 154.16 0.00 0.00 0.00 0.00 0.00 00:18:05.832 =================================================================================================================== 00:18:05.832 Total : 39464.29 154.16 0.00 0.00 0.00 0.00 0.00 00:18:05.832 00:18:06.767 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.767 Nvme0n1 : 8.00 39428.50 154.02 0.00 0.00 0.00 0.00 0.00 00:18:06.767 =================================================================================================================== 00:18:06.767 Total : 39428.50 154.02 0.00 0.00 0.00 0.00 0.00 00:18:06.767 00:18:07.704 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.704 Nvme0n1 : 9.00 39452.89 154.11 0.00 0.00 0.00 0.00 0.00 00:18:07.704 =================================================================================================================== 00:18:07.704 Total : 39452.89 154.11 0.00 0.00 0.00 0.00 0.00 00:18:07.704 00:18:08.641 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.641 Nvme0n1 : 10.00 39478.80 154.21 0.00 0.00 0.00 0.00 0.00 00:18:08.641 =================================================================================================================== 00:18:08.641 Total : 39478.80 154.21 0.00 0.00 0.00 0.00 0.00 00:18:08.641 00:18:08.641 00:18:08.641 Latency(us) 00:18:08.641 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.641 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.641 Nvme0n1 : 10.00 39480.63 154.22 0.00 0.00 3239.50 2063.17 9903.22 00:18:08.641 =================================================================================================================== 00:18:08.641 Total : 39480.63 154.22 0.00 0.00 3239.50 2063.17 9903.22 00:18:08.641 0 00:18:08.641 21:19:02 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1338253 00:18:08.641 21:19:02 -- common/autotest_common.sh@936 -- # '[' -z 1338253 ']' 00:18:08.641 21:19:02 -- common/autotest_common.sh@940 -- # kill -0 1338253 00:18:08.641 21:19:02 -- common/autotest_common.sh@941 -- # uname 00:18:08.641 21:19:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.641 21:19:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1338253 00:18:08.641 21:19:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:08.641 21:19:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:08.641 21:19:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1338253' 00:18:08.641 killing process with pid 1338253 00:18:08.641 21:19:02 -- common/autotest_common.sh@955 -- # kill 1338253 00:18:08.641 Received shutdown signal, test time was about 10.000000 seconds 00:18:08.641 00:18:08.641 Latency(us) 00:18:08.641 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.641 =================================================================================================================== 00:18:08.641 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:08.641 21:19:02 -- common/autotest_common.sh@960 -- # wait 1338253 00:18:08.900 21:19:03 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1334822 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@74 -- # wait 1334822 00:18:09.160 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1334822 Killed "${NVMF_APP[@]}" "$@" 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:09.160 21:19:03 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:09.160 21:19:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:09.160 21:19:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:09.160 21:19:03 -- common/autotest_common.sh@10 -- # set +x 00:18:09.160 21:19:03 -- nvmf/common.sh@470 -- # nvmfpid=1340447 00:18:09.160 21:19:03 -- nvmf/common.sh@471 -- # waitforlisten 1340447 00:18:09.160 21:19:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:09.160 21:19:03 -- common/autotest_common.sh@817 -- # '[' -z 1340447 ']' 00:18:09.160 21:19:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:09.160 21:19:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:09.160 21:19:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:09.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:09.160 21:19:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:09.160 21:19:03 -- common/autotest_common.sh@10 -- # set +x 00:18:09.419 [2024-04-23 21:19:03.468068] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:09.419 [2024-04-23 21:19:03.468114] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:09.419 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.419 [2024-04-23 21:19:03.519232] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.419 [2024-04-23 21:19:03.588471] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:09.419 [2024-04-23 21:19:03.588504] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:09.419 [2024-04-23 21:19:03.588513] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:09.419 [2024-04-23 21:19:03.588519] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:09.419 [2024-04-23 21:19:03.588523] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:09.419 [2024-04-23 21:19:03.588539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:09.987 21:19:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:09.987 21:19:04 -- common/autotest_common.sh@850 -- # return 0 00:18:09.987 21:19:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:09.987 21:19:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:09.987 21:19:04 -- common/autotest_common.sh@10 -- # set +x 00:18:10.247 21:19:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:10.247 21:19:04 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:10.247 [2024-04-23 21:19:04.410817] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:10.247 [2024-04-23 21:19:04.410906] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:10.247 [2024-04-23 21:19:04.410929] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:10.247 21:19:04 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:10.247 21:19:04 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 3a8594c2-84c0-4417-ab57-684dacba8c39 00:18:10.247 21:19:04 -- common/autotest_common.sh@885 -- # local bdev_name=3a8594c2-84c0-4417-ab57-684dacba8c39 00:18:10.247 21:19:04 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:10.247 21:19:04 -- common/autotest_common.sh@887 -- # local i 00:18:10.247 21:19:04 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:10.247 21:19:04 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:10.247 21:19:04 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:10.506 21:19:04 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 3a8594c2-84c0-4417-ab57-684dacba8c39 -t 2000 00:18:10.506 [ 00:18:10.506 { 00:18:10.506 "name": "3a8594c2-84c0-4417-ab57-684dacba8c39", 00:18:10.506 "aliases": [ 00:18:10.506 "lvs/lvol" 00:18:10.506 ], 00:18:10.506 "product_name": "Logical Volume", 00:18:10.506 "block_size": 4096, 00:18:10.506 "num_blocks": 38912, 00:18:10.506 "uuid": "3a8594c2-84c0-4417-ab57-684dacba8c39", 00:18:10.506 "assigned_rate_limits": { 00:18:10.506 "rw_ios_per_sec": 0, 00:18:10.506 "rw_mbytes_per_sec": 0, 00:18:10.506 "r_mbytes_per_sec": 0, 00:18:10.506 "w_mbytes_per_sec": 0 00:18:10.506 }, 00:18:10.506 "claimed": false, 00:18:10.506 "zoned": false, 00:18:10.506 "supported_io_types": { 00:18:10.506 "read": true, 00:18:10.506 "write": true, 00:18:10.506 "unmap": true, 00:18:10.506 "write_zeroes": true, 00:18:10.506 "flush": false, 00:18:10.506 "reset": true, 00:18:10.506 "compare": false, 00:18:10.506 "compare_and_write": false, 00:18:10.506 "abort": false, 00:18:10.506 "nvme_admin": false, 00:18:10.506 "nvme_io": false 00:18:10.506 }, 00:18:10.506 "driver_specific": { 00:18:10.506 "lvol": { 00:18:10.506 "lvol_store_uuid": "089deb5d-e865-48a6-bbe1-63516152448e", 00:18:10.506 "base_bdev": "aio_bdev", 00:18:10.506 "thin_provision": false, 00:18:10.506 "snapshot": false, 00:18:10.506 "clone": false, 00:18:10.506 "esnap_clone": false 00:18:10.506 } 00:18:10.506 } 00:18:10.506 } 00:18:10.506 ] 00:18:10.506 21:19:04 -- common/autotest_common.sh@893 -- # return 0 00:18:10.506 21:19:04 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:10.506 21:19:04 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:10.765 21:19:04 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:10.765 21:19:04 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:10.765 21:19:04 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:11.024 21:19:05 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:11.024 21:19:05 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:11.024 [2024-04-23 21:19:05.175131] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:11.024 21:19:05 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:11.024 21:19:05 -- common/autotest_common.sh@638 -- # local es=0 00:18:11.024 21:19:05 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:11.024 21:19:05 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.024 21:19:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.024 21:19:05 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.024 21:19:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.024 21:19:05 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.024 21:19:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.024 21:19:05 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.024 21:19:05 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:18:11.024 21:19:05 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:11.283 request: 00:18:11.283 { 00:18:11.283 "uuid": "089deb5d-e865-48a6-bbe1-63516152448e", 00:18:11.283 "method": "bdev_lvol_get_lvstores", 00:18:11.283 "req_id": 1 00:18:11.283 } 00:18:11.283 Got JSON-RPC error response 00:18:11.283 response: 00:18:11.283 { 00:18:11.283 "code": -19, 00:18:11.284 "message": "No such device" 00:18:11.284 } 00:18:11.284 21:19:05 -- common/autotest_common.sh@641 -- # es=1 00:18:11.284 21:19:05 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:18:11.284 21:19:05 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:18:11.284 21:19:05 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:18:11.284 21:19:05 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:11.284 aio_bdev 00:18:11.284 21:19:05 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 3a8594c2-84c0-4417-ab57-684dacba8c39 00:18:11.284 21:19:05 -- common/autotest_common.sh@885 -- # local bdev_name=3a8594c2-84c0-4417-ab57-684dacba8c39 00:18:11.284 21:19:05 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:11.284 21:19:05 -- common/autotest_common.sh@887 -- # local i 00:18:11.284 21:19:05 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:11.284 21:19:05 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:11.284 21:19:05 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:11.543 21:19:05 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 3a8594c2-84c0-4417-ab57-684dacba8c39 -t 2000 00:18:11.802 [ 00:18:11.802 { 00:18:11.802 "name": "3a8594c2-84c0-4417-ab57-684dacba8c39", 00:18:11.802 "aliases": [ 00:18:11.802 "lvs/lvol" 00:18:11.802 ], 00:18:11.802 "product_name": "Logical Volume", 00:18:11.802 "block_size": 4096, 00:18:11.802 "num_blocks": 38912, 00:18:11.802 "uuid": "3a8594c2-84c0-4417-ab57-684dacba8c39", 00:18:11.802 "assigned_rate_limits": { 00:18:11.802 "rw_ios_per_sec": 0, 00:18:11.802 "rw_mbytes_per_sec": 0, 00:18:11.802 "r_mbytes_per_sec": 0, 00:18:11.802 "w_mbytes_per_sec": 0 00:18:11.802 }, 00:18:11.802 "claimed": false, 00:18:11.802 "zoned": false, 00:18:11.802 "supported_io_types": { 00:18:11.802 "read": true, 00:18:11.802 "write": true, 00:18:11.802 "unmap": true, 00:18:11.802 "write_zeroes": true, 00:18:11.802 "flush": false, 00:18:11.802 "reset": true, 00:18:11.802 "compare": false, 00:18:11.802 "compare_and_write": false, 00:18:11.802 "abort": false, 00:18:11.802 "nvme_admin": false, 00:18:11.802 "nvme_io": false 00:18:11.802 }, 00:18:11.802 "driver_specific": { 00:18:11.802 "lvol": { 00:18:11.802 "lvol_store_uuid": "089deb5d-e865-48a6-bbe1-63516152448e", 00:18:11.802 "base_bdev": "aio_bdev", 00:18:11.802 "thin_provision": false, 00:18:11.802 "snapshot": false, 00:18:11.802 "clone": false, 00:18:11.802 "esnap_clone": false 00:18:11.802 } 00:18:11.802 } 00:18:11.802 } 00:18:11.802 ] 00:18:11.802 21:19:05 -- common/autotest_common.sh@893 -- # return 0 00:18:11.802 21:19:05 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:11.802 21:19:05 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:11.802 21:19:05 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:11.802 21:19:05 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:11.802 21:19:05 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:12.062 21:19:06 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:12.062 21:19:06 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3a8594c2-84c0-4417-ab57-684dacba8c39 00:18:12.062 21:19:06 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 089deb5d-e865-48a6-bbe1-63516152448e 00:18:12.320 21:19:06 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:12.579 21:19:06 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:12.579 00:18:12.579 real 0m16.744s 00:18:12.579 user 0m44.209s 00:18:12.579 sys 0m2.722s 00:18:12.579 21:19:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:12.579 21:19:06 -- common/autotest_common.sh@10 -- # set +x 00:18:12.579 ************************************ 00:18:12.579 END TEST lvs_grow_dirty 00:18:12.579 ************************************ 00:18:12.579 21:19:06 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:12.579 21:19:06 -- common/autotest_common.sh@794 -- # type=--id 00:18:12.579 21:19:06 -- common/autotest_common.sh@795 -- # id=0 00:18:12.579 21:19:06 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:18:12.579 21:19:06 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:12.579 21:19:06 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:18:12.579 21:19:06 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:18:12.579 21:19:06 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:18:12.579 21:19:06 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:12.579 nvmf_trace.0 00:18:12.579 21:19:06 -- common/autotest_common.sh@809 -- # return 0 00:18:12.579 21:19:06 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:12.579 21:19:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:12.579 21:19:06 -- nvmf/common.sh@117 -- # sync 00:18:12.579 21:19:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:12.579 21:19:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:12.579 21:19:06 -- nvmf/common.sh@120 -- # set +e 00:18:12.579 21:19:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:12.579 21:19:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:12.579 rmmod nvme_rdma 00:18:12.579 rmmod nvme_fabrics 00:18:12.579 21:19:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:12.579 21:19:06 -- nvmf/common.sh@124 -- # set -e 00:18:12.580 21:19:06 -- nvmf/common.sh@125 -- # return 0 00:18:12.580 21:19:06 -- nvmf/common.sh@478 -- # '[' -n 1340447 ']' 00:18:12.580 21:19:06 -- nvmf/common.sh@479 -- # killprocess 1340447 00:18:12.580 21:19:06 -- common/autotest_common.sh@936 -- # '[' -z 1340447 ']' 00:18:12.580 21:19:06 -- common/autotest_common.sh@940 -- # kill -0 1340447 00:18:12.580 21:19:06 -- common/autotest_common.sh@941 -- # uname 00:18:12.580 21:19:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.580 21:19:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1340447 00:18:12.580 21:19:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:12.580 21:19:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:12.580 21:19:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1340447' 00:18:12.580 killing process with pid 1340447 00:18:12.580 21:19:06 -- common/autotest_common.sh@955 -- # kill 1340447 00:18:12.580 21:19:06 -- common/autotest_common.sh@960 -- # wait 1340447 00:18:12.839 21:19:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:12.839 21:19:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:12.839 00:18:12.839 real 0m39.071s 00:18:12.839 user 1m4.863s 00:18:12.839 sys 0m8.207s 00:18:12.839 21:19:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:12.839 21:19:06 -- common/autotest_common.sh@10 -- # set +x 00:18:12.839 ************************************ 00:18:12.839 END TEST nvmf_lvs_grow 00:18:12.839 ************************************ 00:18:12.839 21:19:06 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:12.839 21:19:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:12.839 21:19:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:12.839 21:19:06 -- common/autotest_common.sh@10 -- # set +x 00:18:12.839 ************************************ 00:18:12.839 START TEST nvmf_bdev_io_wait 00:18:12.839 ************************************ 00:18:12.839 21:19:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:13.099 * Looking for test storage... 00:18:13.099 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:13.099 21:19:07 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:13.099 21:19:07 -- nvmf/common.sh@7 -- # uname -s 00:18:13.099 21:19:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:13.099 21:19:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:13.099 21:19:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:13.099 21:19:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:13.099 21:19:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:13.099 21:19:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:13.099 21:19:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:13.099 21:19:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:13.099 21:19:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:13.100 21:19:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:13.100 21:19:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:13.100 21:19:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:13.100 21:19:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:13.100 21:19:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:13.100 21:19:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:13.100 21:19:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:13.100 21:19:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:13.100 21:19:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:13.100 21:19:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:13.100 21:19:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:13.100 21:19:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.100 21:19:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.100 21:19:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.100 21:19:07 -- paths/export.sh@5 -- # export PATH 00:18:13.100 21:19:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.100 21:19:07 -- nvmf/common.sh@47 -- # : 0 00:18:13.100 21:19:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:13.100 21:19:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:13.100 21:19:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:13.100 21:19:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:13.100 21:19:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:13.100 21:19:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:13.100 21:19:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:13.100 21:19:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:13.100 21:19:07 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:13.100 21:19:07 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:13.100 21:19:07 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:13.100 21:19:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:13.100 21:19:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:13.100 21:19:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:13.100 21:19:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:13.100 21:19:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:13.100 21:19:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.100 21:19:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.100 21:19:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.100 21:19:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:13.100 21:19:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:13.100 21:19:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:13.100 21:19:07 -- common/autotest_common.sh@10 -- # set +x 00:18:18.376 21:19:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:18.376 21:19:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:18.376 21:19:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:18.376 21:19:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:18.376 21:19:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:18.376 21:19:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:18.376 21:19:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:18.376 21:19:12 -- nvmf/common.sh@295 -- # net_devs=() 00:18:18.376 21:19:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:18.376 21:19:12 -- nvmf/common.sh@296 -- # e810=() 00:18:18.376 21:19:12 -- nvmf/common.sh@296 -- # local -ga e810 00:18:18.376 21:19:12 -- nvmf/common.sh@297 -- # x722=() 00:18:18.376 21:19:12 -- nvmf/common.sh@297 -- # local -ga x722 00:18:18.376 21:19:12 -- nvmf/common.sh@298 -- # mlx=() 00:18:18.376 21:19:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:18.376 21:19:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:18.376 21:19:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:18.376 21:19:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:18.376 21:19:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:18.376 21:19:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:18.376 21:19:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:18.376 21:19:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:18.376 21:19:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:18.376 21:19:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:18.377 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:18.377 21:19:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:18.377 21:19:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:18.377 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:18.377 21:19:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:18.377 21:19:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.377 21:19:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.377 21:19:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:18.377 Found net devices under 0000:18:00.0: mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.377 21:19:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:18.377 21:19:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:18.377 21:19:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:18.377 Found net devices under 0000:18:00.1: mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:18.377 21:19:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:18.377 21:19:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:18.377 21:19:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:18.377 21:19:12 -- nvmf/common.sh@58 -- # uname 00:18:18.377 21:19:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:18.377 21:19:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:18.377 21:19:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:18.377 21:19:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:18.377 21:19:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:18.377 21:19:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:18.377 21:19:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:18.377 21:19:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:18.377 21:19:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:18.377 21:19:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:18.377 21:19:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:18.377 21:19:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:18.377 21:19:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:18.377 21:19:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:18.377 21:19:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:18.377 21:19:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@105 -- # continue 2 00:18:18.377 21:19:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@105 -- # continue 2 00:18:18.377 21:19:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:18.377 21:19:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:18.377 21:19:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:18.377 21:19:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:18.377 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:18.377 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:18.377 altname enp24s0f0np0 00:18:18.377 altname ens785f0np0 00:18:18.377 inet 192.168.100.8/24 scope global mlx_0_0 00:18:18.377 valid_lft forever preferred_lft forever 00:18:18.377 21:19:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:18.377 21:19:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:18.377 21:19:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:18.377 21:19:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:18.377 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:18.377 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:18.377 altname enp24s0f1np1 00:18:18.377 altname ens785f1np1 00:18:18.377 inet 192.168.100.9/24 scope global mlx_0_1 00:18:18.377 valid_lft forever preferred_lft forever 00:18:18.377 21:19:12 -- nvmf/common.sh@411 -- # return 0 00:18:18.377 21:19:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:18.377 21:19:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:18.377 21:19:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:18.377 21:19:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:18.377 21:19:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:18.377 21:19:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:18.377 21:19:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:18.377 21:19:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:18.377 21:19:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:18.377 21:19:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@105 -- # continue 2 00:18:18.377 21:19:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:18.377 21:19:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:18.377 21:19:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@105 -- # continue 2 00:18:18.377 21:19:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:18.377 21:19:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:18.377 21:19:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:18.377 21:19:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:18.377 21:19:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:18.377 21:19:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:18.377 192.168.100.9' 00:18:18.377 21:19:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:18.377 192.168.100.9' 00:18:18.377 21:19:12 -- nvmf/common.sh@446 -- # head -n 1 00:18:18.377 21:19:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:18.377 21:19:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:18.377 192.168.100.9' 00:18:18.377 21:19:12 -- nvmf/common.sh@447 -- # tail -n +2 00:18:18.377 21:19:12 -- nvmf/common.sh@447 -- # head -n 1 00:18:18.377 21:19:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:18.377 21:19:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:18.377 21:19:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:18.377 21:19:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:18.377 21:19:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:18.377 21:19:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:18.377 21:19:12 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:18.377 21:19:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:18.377 21:19:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:18.377 21:19:12 -- common/autotest_common.sh@10 -- # set +x 00:18:18.377 21:19:12 -- nvmf/common.sh@470 -- # nvmfpid=1344389 00:18:18.377 21:19:12 -- nvmf/common.sh@471 -- # waitforlisten 1344389 00:18:18.377 21:19:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:18.377 21:19:12 -- common/autotest_common.sh@817 -- # '[' -z 1344389 ']' 00:18:18.377 21:19:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:18.377 21:19:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:18.377 21:19:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:18.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:18.378 21:19:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:18.378 21:19:12 -- common/autotest_common.sh@10 -- # set +x 00:18:18.378 [2024-04-23 21:19:12.578751] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:18.378 [2024-04-23 21:19:12.578792] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:18.378 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.378 [2024-04-23 21:19:12.627887] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:18.637 [2024-04-23 21:19:12.701025] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:18.637 [2024-04-23 21:19:12.701061] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:18.637 [2024-04-23 21:19:12.701067] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:18.637 [2024-04-23 21:19:12.701072] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:18.637 [2024-04-23 21:19:12.701077] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:18.637 [2024-04-23 21:19:12.701111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:18.637 [2024-04-23 21:19:12.701206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:18.637 [2024-04-23 21:19:12.701298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:18.637 [2024-04-23 21:19:12.701300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:19.205 21:19:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:19.205 21:19:13 -- common/autotest_common.sh@850 -- # return 0 00:18:19.205 21:19:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:19.205 21:19:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:19.205 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.205 21:19:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:19.205 21:19:13 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:19.205 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.205 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.205 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.205 21:19:13 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:19.205 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.205 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.205 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.205 21:19:13 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:19.205 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.205 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 [2024-04-23 21:19:13.487174] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1204730/0x1208c20) succeed. 00:18:19.465 [2024-04-23 21:19:13.497651] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1205d70/0x124a2b0) succeed. 00:18:19.465 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:19.465 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.465 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 Malloc0 00:18:19.465 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:19.465 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.465 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:19.465 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.465 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:19.465 21:19:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:19.465 21:19:13 -- common/autotest_common.sh@10 -- # set +x 00:18:19.465 [2024-04-23 21:19:13.670696] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:19.465 21:19:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1344661 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@30 -- # READ_PID=1344663 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # config=() 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # local subsystem config 00:18:19.465 21:19:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:19.465 { 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme$subsystem", 00:18:19.465 "trtype": "$TEST_TRANSPORT", 00:18:19.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "$NVMF_PORT", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:19.465 "hdgst": ${hdgst:-false}, 00:18:19.465 "ddgst": ${ddgst:-false} 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 } 00:18:19.465 EOF 00:18:19.465 )") 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1344665 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # config=() 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # local subsystem config 00:18:19.465 21:19:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:19.465 { 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme$subsystem", 00:18:19.465 "trtype": "$TEST_TRANSPORT", 00:18:19.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "$NVMF_PORT", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:19.465 "hdgst": ${hdgst:-false}, 00:18:19.465 "ddgst": ${ddgst:-false} 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 } 00:18:19.465 EOF 00:18:19.465 )") 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1344668 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@35 -- # sync 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # cat 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # config=() 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # local subsystem config 00:18:19.465 21:19:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:19.465 { 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme$subsystem", 00:18:19.465 "trtype": "$TEST_TRANSPORT", 00:18:19.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "$NVMF_PORT", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:19.465 "hdgst": ${hdgst:-false}, 00:18:19.465 "ddgst": ${ddgst:-false} 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 } 00:18:19.465 EOF 00:18:19.465 )") 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # config=() 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # cat 00:18:19.465 21:19:13 -- nvmf/common.sh@521 -- # local subsystem config 00:18:19.465 21:19:13 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:19.465 { 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme$subsystem", 00:18:19.465 "trtype": "$TEST_TRANSPORT", 00:18:19.465 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "$NVMF_PORT", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:19.465 "hdgst": ${hdgst:-false}, 00:18:19.465 "ddgst": ${ddgst:-false} 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 } 00:18:19.465 EOF 00:18:19.465 )") 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # cat 00:18:19.465 21:19:13 -- target/bdev_io_wait.sh@37 -- # wait 1344661 00:18:19.465 21:19:13 -- nvmf/common.sh@543 -- # cat 00:18:19.465 21:19:13 -- nvmf/common.sh@545 -- # jq . 00:18:19.465 21:19:13 -- nvmf/common.sh@545 -- # jq . 00:18:19.465 21:19:13 -- nvmf/common.sh@545 -- # jq . 00:18:19.465 21:19:13 -- nvmf/common.sh@546 -- # IFS=, 00:18:19.465 21:19:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme1", 00:18:19.465 "trtype": "rdma", 00:18:19.465 "traddr": "192.168.100.8", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "4420", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.465 "hdgst": false, 00:18:19.465 "ddgst": false 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 }' 00:18:19.465 21:19:13 -- nvmf/common.sh@545 -- # jq . 00:18:19.465 21:19:13 -- nvmf/common.sh@546 -- # IFS=, 00:18:19.465 21:19:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme1", 00:18:19.465 "trtype": "rdma", 00:18:19.465 "traddr": "192.168.100.8", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "4420", 00:18:19.465 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.465 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.465 "hdgst": false, 00:18:19.465 "ddgst": false 00:18:19.465 }, 00:18:19.465 "method": "bdev_nvme_attach_controller" 00:18:19.465 }' 00:18:19.465 21:19:13 -- nvmf/common.sh@546 -- # IFS=, 00:18:19.465 21:19:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:19.465 "params": { 00:18:19.465 "name": "Nvme1", 00:18:19.465 "trtype": "rdma", 00:18:19.465 "traddr": "192.168.100.8", 00:18:19.465 "adrfam": "ipv4", 00:18:19.465 "trsvcid": "4420", 00:18:19.466 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.466 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.466 "hdgst": false, 00:18:19.466 "ddgst": false 00:18:19.466 }, 00:18:19.466 "method": "bdev_nvme_attach_controller" 00:18:19.466 }' 00:18:19.466 21:19:13 -- nvmf/common.sh@546 -- # IFS=, 00:18:19.466 21:19:13 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:19.466 "params": { 00:18:19.466 "name": "Nvme1", 00:18:19.466 "trtype": "rdma", 00:18:19.466 "traddr": "192.168.100.8", 00:18:19.466 "adrfam": "ipv4", 00:18:19.466 "trsvcid": "4420", 00:18:19.466 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:19.466 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:19.466 "hdgst": false, 00:18:19.466 "ddgst": false 00:18:19.466 }, 00:18:19.466 "method": "bdev_nvme_attach_controller" 00:18:19.466 }' 00:18:19.466 [2024-04-23 21:19:13.714982] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:19.466 [2024-04-23 21:19:13.715027] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:19.466 [2024-04-23 21:19:13.717801] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:19.466 [2024-04-23 21:19:13.717840] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:19.466 [2024-04-23 21:19:13.718586] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:19.466 [2024-04-23 21:19:13.718621] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:19.466 [2024-04-23 21:19:13.721821] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:19.466 [2024-04-23 21:19:13.721861] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:19.725 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.725 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.725 [2024-04-23 21:19:13.880871] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.725 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.725 [2024-04-23 21:19:13.950450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:19.725 [2024-04-23 21:19:13.965009] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.983 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.983 [2024-04-23 21:19:14.035380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:19.983 [2024-04-23 21:19:14.057522] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.983 [2024-04-23 21:19:14.116045] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.983 [2024-04-23 21:19:14.132559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:19.983 [2024-04-23 21:19:14.186180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:19.983 Running I/O for 1 seconds... 00:18:20.242 Running I/O for 1 seconds... 00:18:20.242 Running I/O for 1 seconds... 00:18:20.242 Running I/O for 1 seconds... 00:18:21.178 00:18:21.178 Latency(us) 00:18:21.178 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.179 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:21.179 Nvme1n1 : 1.00 19132.45 74.74 0.00 0.00 6671.22 3519.53 13689.74 00:18:21.179 =================================================================================================================== 00:18:21.179 Total : 19132.45 74.74 0.00 0.00 6671.22 3519.53 13689.74 00:18:21.179 00:18:21.179 Latency(us) 00:18:21.179 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.179 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:21.179 Nvme1n1 : 1.00 15483.35 60.48 0.00 0.00 8243.69 4830.25 19320.98 00:18:21.179 =================================================================================================================== 00:18:21.179 Total : 15483.35 60.48 0.00 0.00 8243.69 4830.25 19320.98 00:18:21.179 00:18:21.179 Latency(us) 00:18:21.179 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.179 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:21.179 Nvme1n1 : 1.00 18796.98 73.43 0.00 0.00 6793.15 4053.52 16796.63 00:18:21.179 =================================================================================================================== 00:18:21.179 Total : 18796.98 73.43 0.00 0.00 6793.15 4053.52 16796.63 00:18:21.179 00:18:21.179 Latency(us) 00:18:21.179 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.179 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:21.179 Nvme1n1 : 1.00 285005.57 1113.30 0.00 0.00 447.04 175.98 1699.08 00:18:21.179 =================================================================================================================== 00:18:21.179 Total : 285005.57 1113.30 0.00 0.00 447.04 175.98 1699.08 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@38 -- # wait 1344663 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@39 -- # wait 1344665 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@40 -- # wait 1344668 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:21.438 21:19:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:21.438 21:19:15 -- common/autotest_common.sh@10 -- # set +x 00:18:21.438 21:19:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:21.438 21:19:15 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:21.438 21:19:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:21.438 21:19:15 -- nvmf/common.sh@117 -- # sync 00:18:21.438 21:19:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:21.438 21:19:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:21.438 21:19:15 -- nvmf/common.sh@120 -- # set +e 00:18:21.438 21:19:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:21.438 21:19:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:21.438 rmmod nvme_rdma 00:18:21.438 rmmod nvme_fabrics 00:18:21.438 21:19:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:21.438 21:19:15 -- nvmf/common.sh@124 -- # set -e 00:18:21.438 21:19:15 -- nvmf/common.sh@125 -- # return 0 00:18:21.438 21:19:15 -- nvmf/common.sh@478 -- # '[' -n 1344389 ']' 00:18:21.438 21:19:15 -- nvmf/common.sh@479 -- # killprocess 1344389 00:18:21.438 21:19:15 -- common/autotest_common.sh@936 -- # '[' -z 1344389 ']' 00:18:21.438 21:19:15 -- common/autotest_common.sh@940 -- # kill -0 1344389 00:18:21.438 21:19:15 -- common/autotest_common.sh@941 -- # uname 00:18:21.438 21:19:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.438 21:19:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1344389 00:18:21.697 21:19:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:21.697 21:19:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:21.697 21:19:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1344389' 00:18:21.697 killing process with pid 1344389 00:18:21.697 21:19:15 -- common/autotest_common.sh@955 -- # kill 1344389 00:18:21.697 21:19:15 -- common/autotest_common.sh@960 -- # wait 1344389 00:18:21.697 [2024-04-23 21:19:15.795886] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:21.956 21:19:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:21.956 21:19:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:21.956 00:18:21.956 real 0m8.871s 00:18:21.956 user 0m20.203s 00:18:21.956 sys 0m5.119s 00:18:21.956 21:19:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:21.956 21:19:15 -- common/autotest_common.sh@10 -- # set +x 00:18:21.956 ************************************ 00:18:21.956 END TEST nvmf_bdev_io_wait 00:18:21.956 ************************************ 00:18:21.956 21:19:16 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:21.956 21:19:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:21.956 21:19:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:21.956 21:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:21.956 ************************************ 00:18:21.956 START TEST nvmf_queue_depth 00:18:21.956 ************************************ 00:18:21.956 21:19:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:21.956 * Looking for test storage... 00:18:21.956 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:21.956 21:19:16 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:21.956 21:19:16 -- nvmf/common.sh@7 -- # uname -s 00:18:21.956 21:19:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:21.956 21:19:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:21.956 21:19:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:21.956 21:19:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:21.956 21:19:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:21.956 21:19:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:21.956 21:19:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:21.956 21:19:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:21.956 21:19:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:21.956 21:19:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:21.956 21:19:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:21.956 21:19:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:21.956 21:19:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:21.956 21:19:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:21.956 21:19:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:21.956 21:19:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:21.956 21:19:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:21.956 21:19:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:21.956 21:19:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:21.956 21:19:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:21.956 21:19:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.957 21:19:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.957 21:19:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.957 21:19:16 -- paths/export.sh@5 -- # export PATH 00:18:21.957 21:19:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.957 21:19:16 -- nvmf/common.sh@47 -- # : 0 00:18:21.957 21:19:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:21.957 21:19:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:21.957 21:19:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:21.957 21:19:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:21.957 21:19:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:21.957 21:19:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:21.957 21:19:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:21.957 21:19:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:21.957 21:19:16 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:21.957 21:19:16 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:21.957 21:19:16 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:21.957 21:19:16 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:21.957 21:19:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:21.957 21:19:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:21.957 21:19:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:21.957 21:19:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:21.957 21:19:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:21.957 21:19:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.957 21:19:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.957 21:19:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.957 21:19:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:21.957 21:19:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:21.957 21:19:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:21.957 21:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:27.318 21:19:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:27.318 21:19:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:27.318 21:19:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:27.318 21:19:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:27.318 21:19:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:27.318 21:19:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:27.318 21:19:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:27.318 21:19:21 -- nvmf/common.sh@295 -- # net_devs=() 00:18:27.318 21:19:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:27.318 21:19:21 -- nvmf/common.sh@296 -- # e810=() 00:18:27.318 21:19:21 -- nvmf/common.sh@296 -- # local -ga e810 00:18:27.318 21:19:21 -- nvmf/common.sh@297 -- # x722=() 00:18:27.318 21:19:21 -- nvmf/common.sh@297 -- # local -ga x722 00:18:27.318 21:19:21 -- nvmf/common.sh@298 -- # mlx=() 00:18:27.318 21:19:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:27.318 21:19:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:27.318 21:19:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:27.319 21:19:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:27.319 21:19:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:27.319 21:19:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:27.319 21:19:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:27.319 21:19:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:27.319 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:27.319 21:19:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:27.319 21:19:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:27.319 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:27.319 21:19:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:27.319 21:19:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:27.319 21:19:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:27.319 21:19:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:27.319 Found net devices under 0000:18:00.0: mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:27.319 21:19:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:27.319 21:19:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:27.319 Found net devices under 0000:18:00.1: mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:27.319 21:19:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:27.319 21:19:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:27.319 21:19:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:27.319 21:19:21 -- nvmf/common.sh@58 -- # uname 00:18:27.319 21:19:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:27.319 21:19:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:27.319 21:19:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:27.319 21:19:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:27.319 21:19:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:27.319 21:19:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:27.319 21:19:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:27.319 21:19:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:27.319 21:19:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:27.319 21:19:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:27.319 21:19:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:27.319 21:19:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:27.319 21:19:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:27.319 21:19:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:27.319 21:19:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:27.319 21:19:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@105 -- # continue 2 00:18:27.319 21:19:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@105 -- # continue 2 00:18:27.319 21:19:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:27.319 21:19:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:27.319 21:19:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:27.319 21:19:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:27.319 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:27.319 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:27.319 altname enp24s0f0np0 00:18:27.319 altname ens785f0np0 00:18:27.319 inet 192.168.100.8/24 scope global mlx_0_0 00:18:27.319 valid_lft forever preferred_lft forever 00:18:27.319 21:19:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:27.319 21:19:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:27.319 21:19:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:27.319 21:19:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:27.319 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:27.319 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:27.319 altname enp24s0f1np1 00:18:27.319 altname ens785f1np1 00:18:27.319 inet 192.168.100.9/24 scope global mlx_0_1 00:18:27.319 valid_lft forever preferred_lft forever 00:18:27.319 21:19:21 -- nvmf/common.sh@411 -- # return 0 00:18:27.319 21:19:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:27.319 21:19:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:27.319 21:19:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:27.319 21:19:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:27.319 21:19:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:27.319 21:19:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:27.319 21:19:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:27.319 21:19:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:27.319 21:19:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:27.319 21:19:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@105 -- # continue 2 00:18:27.319 21:19:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:27.319 21:19:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:27.319 21:19:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@105 -- # continue 2 00:18:27.319 21:19:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:27.319 21:19:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:27.319 21:19:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:27.319 21:19:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:27.319 21:19:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:27.319 21:19:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:27.319 192.168.100.9' 00:18:27.319 21:19:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:27.319 192.168.100.9' 00:18:27.319 21:19:21 -- nvmf/common.sh@446 -- # head -n 1 00:18:27.319 21:19:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:27.319 21:19:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:27.319 192.168.100.9' 00:18:27.319 21:19:21 -- nvmf/common.sh@447 -- # tail -n +2 00:18:27.319 21:19:21 -- nvmf/common.sh@447 -- # head -n 1 00:18:27.319 21:19:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:27.319 21:19:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:27.319 21:19:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:27.319 21:19:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:27.319 21:19:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:27.319 21:19:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:27.319 21:19:21 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:27.320 21:19:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:27.320 21:19:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:27.320 21:19:21 -- common/autotest_common.sh@10 -- # set +x 00:18:27.320 21:19:21 -- nvmf/common.sh@470 -- # nvmfpid=1348460 00:18:27.320 21:19:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:27.320 21:19:21 -- nvmf/common.sh@471 -- # waitforlisten 1348460 00:18:27.320 21:19:21 -- common/autotest_common.sh@817 -- # '[' -z 1348460 ']' 00:18:27.320 21:19:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:27.320 21:19:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:27.320 21:19:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:27.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:27.320 21:19:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:27.320 21:19:21 -- common/autotest_common.sh@10 -- # set +x 00:18:27.579 [2024-04-23 21:19:21.614880] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:27.579 [2024-04-23 21:19:21.614926] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:27.579 EAL: No free 2048 kB hugepages reported on node 1 00:18:27.579 [2024-04-23 21:19:21.665124] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.579 [2024-04-23 21:19:21.734880] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:27.579 [2024-04-23 21:19:21.734913] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:27.579 [2024-04-23 21:19:21.734920] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:27.579 [2024-04-23 21:19:21.734926] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:27.579 [2024-04-23 21:19:21.734931] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:27.579 [2024-04-23 21:19:21.734947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:28.144 21:19:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:28.144 21:19:22 -- common/autotest_common.sh@850 -- # return 0 00:18:28.144 21:19:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:28.144 21:19:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:28.144 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 21:19:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:28.402 21:19:22 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:28.402 21:19:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:28.402 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 [2024-04-23 21:19:22.451530] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1096820/0x109ad10) succeed. 00:18:28.402 [2024-04-23 21:19:22.459946] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1097d20/0x10dc3a0) succeed. 00:18:28.402 21:19:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.402 21:19:22 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:28.402 21:19:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:28.402 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 Malloc0 00:18:28.402 21:19:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.402 21:19:22 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:28.402 21:19:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:28.402 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 21:19:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.402 21:19:22 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:28.402 21:19:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:28.402 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 21:19:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.402 21:19:22 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:28.402 21:19:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:28.402 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.402 [2024-04-23 21:19:22.550816] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:28.402 21:19:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:28.402 21:19:22 -- target/queue_depth.sh@30 -- # bdevperf_pid=1348581 00:18:28.402 21:19:22 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:28.402 21:19:22 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:28.402 21:19:22 -- target/queue_depth.sh@33 -- # waitforlisten 1348581 /var/tmp/bdevperf.sock 00:18:28.403 21:19:22 -- common/autotest_common.sh@817 -- # '[' -z 1348581 ']' 00:18:28.403 21:19:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:28.403 21:19:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:28.403 21:19:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:28.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:28.403 21:19:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:28.403 21:19:22 -- common/autotest_common.sh@10 -- # set +x 00:18:28.403 [2024-04-23 21:19:22.594840] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:28.403 [2024-04-23 21:19:22.594879] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1348581 ] 00:18:28.403 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.403 [2024-04-23 21:19:22.644074] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:28.661 [2024-04-23 21:19:22.710988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:29.226 21:19:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:29.226 21:19:23 -- common/autotest_common.sh@850 -- # return 0 00:18:29.226 21:19:23 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:29.226 21:19:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:29.226 21:19:23 -- common/autotest_common.sh@10 -- # set +x 00:18:29.226 NVMe0n1 00:18:29.226 21:19:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:29.226 21:19:23 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:29.483 Running I/O for 10 seconds... 00:18:39.459 00:18:39.459 Latency(us) 00:18:39.459 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.459 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:39.459 Verification LBA range: start 0x0 length 0x4000 00:18:39.459 NVMe0n1 : 10.03 19437.19 75.93 0.00 0.00 52535.80 7961.41 33787.45 00:18:39.459 =================================================================================================================== 00:18:39.459 Total : 19437.19 75.93 0.00 0.00 52535.80 7961.41 33787.45 00:18:39.459 0 00:18:39.459 21:19:33 -- target/queue_depth.sh@39 -- # killprocess 1348581 00:18:39.459 21:19:33 -- common/autotest_common.sh@936 -- # '[' -z 1348581 ']' 00:18:39.459 21:19:33 -- common/autotest_common.sh@940 -- # kill -0 1348581 00:18:39.459 21:19:33 -- common/autotest_common.sh@941 -- # uname 00:18:39.459 21:19:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.459 21:19:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1348581 00:18:39.459 21:19:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:39.459 21:19:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:39.459 21:19:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1348581' 00:18:39.459 killing process with pid 1348581 00:18:39.459 21:19:33 -- common/autotest_common.sh@955 -- # kill 1348581 00:18:39.459 Received shutdown signal, test time was about 10.000000 seconds 00:18:39.459 00:18:39.459 Latency(us) 00:18:39.459 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.459 =================================================================================================================== 00:18:39.459 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:39.459 21:19:33 -- common/autotest_common.sh@960 -- # wait 1348581 00:18:39.718 21:19:33 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:39.718 21:19:33 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:39.718 21:19:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:39.718 21:19:33 -- nvmf/common.sh@117 -- # sync 00:18:39.718 21:19:33 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:39.718 21:19:33 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:39.718 21:19:33 -- nvmf/common.sh@120 -- # set +e 00:18:39.718 21:19:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:39.718 21:19:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:39.718 rmmod nvme_rdma 00:18:39.718 rmmod nvme_fabrics 00:18:39.718 21:19:33 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:39.718 21:19:33 -- nvmf/common.sh@124 -- # set -e 00:18:39.718 21:19:33 -- nvmf/common.sh@125 -- # return 0 00:18:39.718 21:19:33 -- nvmf/common.sh@478 -- # '[' -n 1348460 ']' 00:18:39.718 21:19:33 -- nvmf/common.sh@479 -- # killprocess 1348460 00:18:39.718 21:19:33 -- common/autotest_common.sh@936 -- # '[' -z 1348460 ']' 00:18:39.718 21:19:33 -- common/autotest_common.sh@940 -- # kill -0 1348460 00:18:39.718 21:19:33 -- common/autotest_common.sh@941 -- # uname 00:18:39.718 21:19:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.718 21:19:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1348460 00:18:39.718 21:19:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:39.718 21:19:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:39.718 21:19:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1348460' 00:18:39.718 killing process with pid 1348460 00:18:39.718 21:19:33 -- common/autotest_common.sh@955 -- # kill 1348460 00:18:39.718 21:19:33 -- common/autotest_common.sh@960 -- # wait 1348460 00:18:39.718 [2024-04-23 21:19:33.983475] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:39.977 21:19:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:39.977 21:19:34 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:39.977 00:18:39.977 real 0m18.084s 00:18:39.977 user 0m25.593s 00:18:39.977 sys 0m4.614s 00:18:39.977 21:19:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:39.977 21:19:34 -- common/autotest_common.sh@10 -- # set +x 00:18:39.977 ************************************ 00:18:39.977 END TEST nvmf_queue_depth 00:18:39.977 ************************************ 00:18:39.977 21:19:34 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:39.977 21:19:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:39.977 21:19:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:39.977 21:19:34 -- common/autotest_common.sh@10 -- # set +x 00:18:40.235 ************************************ 00:18:40.235 START TEST nvmf_multipath 00:18:40.235 ************************************ 00:18:40.235 21:19:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:40.235 * Looking for test storage... 00:18:40.235 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:40.235 21:19:34 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.235 21:19:34 -- nvmf/common.sh@7 -- # uname -s 00:18:40.235 21:19:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.235 21:19:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.235 21:19:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.235 21:19:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.235 21:19:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.235 21:19:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.235 21:19:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.235 21:19:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.236 21:19:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.236 21:19:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.236 21:19:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:40.236 21:19:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:40.236 21:19:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.236 21:19:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.236 21:19:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.236 21:19:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:40.236 21:19:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:40.236 21:19:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.236 21:19:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.236 21:19:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.236 21:19:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.236 21:19:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.236 21:19:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.236 21:19:34 -- paths/export.sh@5 -- # export PATH 00:18:40.236 21:19:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.236 21:19:34 -- nvmf/common.sh@47 -- # : 0 00:18:40.236 21:19:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:40.236 21:19:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:40.236 21:19:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:40.236 21:19:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.236 21:19:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.236 21:19:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:40.236 21:19:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:40.236 21:19:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:40.236 21:19:34 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:40.236 21:19:34 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:40.236 21:19:34 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:40.236 21:19:34 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:40.236 21:19:34 -- target/multipath.sh@43 -- # nvmftestinit 00:18:40.236 21:19:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:40.236 21:19:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.236 21:19:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:40.236 21:19:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:40.236 21:19:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:40.236 21:19:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.236 21:19:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.236 21:19:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.236 21:19:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:40.236 21:19:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:40.236 21:19:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:40.236 21:19:34 -- common/autotest_common.sh@10 -- # set +x 00:18:45.506 21:19:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:45.506 21:19:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:45.506 21:19:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:45.506 21:19:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:45.506 21:19:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:45.506 21:19:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:45.506 21:19:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:45.506 21:19:39 -- nvmf/common.sh@295 -- # net_devs=() 00:18:45.506 21:19:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:45.506 21:19:39 -- nvmf/common.sh@296 -- # e810=() 00:18:45.506 21:19:39 -- nvmf/common.sh@296 -- # local -ga e810 00:18:45.506 21:19:39 -- nvmf/common.sh@297 -- # x722=() 00:18:45.506 21:19:39 -- nvmf/common.sh@297 -- # local -ga x722 00:18:45.506 21:19:39 -- nvmf/common.sh@298 -- # mlx=() 00:18:45.506 21:19:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:45.506 21:19:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:45.506 21:19:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:45.506 21:19:39 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:45.506 21:19:39 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:45.506 21:19:39 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:45.506 21:19:39 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:45.506 21:19:39 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:45.506 21:19:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:45.506 21:19:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:45.506 21:19:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:45.506 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:45.506 21:19:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:45.507 21:19:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:45.507 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:45.507 21:19:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:45.507 21:19:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:45.507 21:19:39 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.507 21:19:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:45.507 21:19:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.507 21:19:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:45.507 Found net devices under 0000:18:00.0: mlx_0_0 00:18:45.507 21:19:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.507 21:19:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.507 21:19:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:45.507 21:19:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.507 21:19:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:45.507 Found net devices under 0000:18:00.1: mlx_0_1 00:18:45.507 21:19:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.507 21:19:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:45.507 21:19:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:45.507 21:19:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:45.507 21:19:39 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:45.507 21:19:39 -- nvmf/common.sh@58 -- # uname 00:18:45.507 21:19:39 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:45.507 21:19:39 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:45.507 21:19:39 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:45.507 21:19:39 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:45.507 21:19:39 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:45.507 21:19:39 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:45.507 21:19:39 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:45.507 21:19:39 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:45.507 21:19:39 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:45.507 21:19:39 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:45.507 21:19:39 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:45.507 21:19:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:45.507 21:19:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:45.507 21:19:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:45.507 21:19:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:45.507 21:19:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:45.507 21:19:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:45.507 21:19:39 -- nvmf/common.sh@105 -- # continue 2 00:18:45.507 21:19:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.507 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:45.507 21:19:39 -- nvmf/common.sh@105 -- # continue 2 00:18:45.507 21:19:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:45.507 21:19:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:45.507 21:19:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.507 21:19:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:45.507 21:19:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:45.507 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:45.507 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:45.507 altname enp24s0f0np0 00:18:45.507 altname ens785f0np0 00:18:45.507 inet 192.168.100.8/24 scope global mlx_0_0 00:18:45.507 valid_lft forever preferred_lft forever 00:18:45.507 21:19:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:45.507 21:19:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:45.507 21:19:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:45.507 21:19:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.507 21:19:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:45.507 21:19:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:45.507 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:45.507 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:45.507 altname enp24s0f1np1 00:18:45.507 altname ens785f1np1 00:18:45.507 inet 192.168.100.9/24 scope global mlx_0_1 00:18:45.507 valid_lft forever preferred_lft forever 00:18:45.507 21:19:39 -- nvmf/common.sh@411 -- # return 0 00:18:45.507 21:19:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:45.507 21:19:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:45.507 21:19:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:45.507 21:19:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:45.507 21:19:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:45.507 21:19:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:45.507 21:19:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:45.507 21:19:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:45.507 21:19:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:45.767 21:19:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:45.767 21:19:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.767 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.767 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:45.767 21:19:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:45.767 21:19:39 -- nvmf/common.sh@105 -- # continue 2 00:18:45.767 21:19:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.767 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.767 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:45.767 21:19:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.767 21:19:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:45.767 21:19:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:45.767 21:19:39 -- nvmf/common.sh@105 -- # continue 2 00:18:45.767 21:19:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:45.767 21:19:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:45.767 21:19:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.767 21:19:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:45.767 21:19:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:45.767 21:19:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.767 21:19:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.767 21:19:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:45.767 192.168.100.9' 00:18:45.767 21:19:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:45.767 192.168.100.9' 00:18:45.767 21:19:39 -- nvmf/common.sh@446 -- # head -n 1 00:18:45.767 21:19:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:45.767 21:19:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:45.767 192.168.100.9' 00:18:45.767 21:19:39 -- nvmf/common.sh@447 -- # tail -n +2 00:18:45.767 21:19:39 -- nvmf/common.sh@447 -- # head -n 1 00:18:45.767 21:19:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:45.767 21:19:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:45.767 21:19:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:45.767 21:19:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:45.767 21:19:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:45.767 21:19:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:45.767 21:19:39 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:18:45.767 21:19:39 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:18:45.767 21:19:39 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:18:45.767 run this test only with TCP transport for now 00:18:45.767 21:19:39 -- target/multipath.sh@53 -- # nvmftestfini 00:18:45.767 21:19:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:45.767 21:19:39 -- nvmf/common.sh@117 -- # sync 00:18:45.767 21:19:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:45.767 21:19:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:45.767 21:19:39 -- nvmf/common.sh@120 -- # set +e 00:18:45.767 21:19:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:45.767 21:19:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:45.768 rmmod nvme_rdma 00:18:45.768 rmmod nvme_fabrics 00:18:45.768 21:19:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:45.768 21:19:39 -- nvmf/common.sh@124 -- # set -e 00:18:45.768 21:19:39 -- nvmf/common.sh@125 -- # return 0 00:18:45.768 21:19:39 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:45.768 21:19:39 -- target/multipath.sh@54 -- # exit 0 00:18:45.768 21:19:39 -- target/multipath.sh@1 -- # nvmftestfini 00:18:45.768 21:19:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:45.768 21:19:39 -- nvmf/common.sh@117 -- # sync 00:18:45.768 21:19:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@120 -- # set +e 00:18:45.768 21:19:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:45.768 21:19:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:45.768 21:19:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:45.768 21:19:39 -- nvmf/common.sh@124 -- # set -e 00:18:45.768 21:19:39 -- nvmf/common.sh@125 -- # return 0 00:18:45.768 21:19:39 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:45.768 21:19:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:45.768 00:18:45.768 real 0m5.571s 00:18:45.768 user 0m1.630s 00:18:45.768 sys 0m4.064s 00:18:45.768 21:19:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:45.768 21:19:39 -- common/autotest_common.sh@10 -- # set +x 00:18:45.768 ************************************ 00:18:45.768 END TEST nvmf_multipath 00:18:45.768 ************************************ 00:18:45.768 21:19:39 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:18:45.768 21:19:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.768 21:19:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.768 21:19:39 -- common/autotest_common.sh@10 -- # set +x 00:18:46.028 ************************************ 00:18:46.028 START TEST nvmf_zcopy 00:18:46.028 ************************************ 00:18:46.028 21:19:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:18:46.028 * Looking for test storage... 00:18:46.028 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:46.028 21:19:40 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:46.028 21:19:40 -- nvmf/common.sh@7 -- # uname -s 00:18:46.028 21:19:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:46.028 21:19:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:46.028 21:19:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:46.028 21:19:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:46.028 21:19:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:46.028 21:19:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:46.028 21:19:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:46.028 21:19:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:46.028 21:19:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:46.028 21:19:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:46.028 21:19:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:46.028 21:19:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:46.028 21:19:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:46.028 21:19:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:46.028 21:19:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:46.028 21:19:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:46.028 21:19:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:46.028 21:19:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:46.028 21:19:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:46.028 21:19:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:46.028 21:19:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.028 21:19:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.028 21:19:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.028 21:19:40 -- paths/export.sh@5 -- # export PATH 00:18:46.028 21:19:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:46.028 21:19:40 -- nvmf/common.sh@47 -- # : 0 00:18:46.028 21:19:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:46.028 21:19:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:46.028 21:19:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:46.028 21:19:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:46.028 21:19:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:46.028 21:19:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:46.028 21:19:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:46.028 21:19:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:46.028 21:19:40 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:46.028 21:19:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:46.028 21:19:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:46.028 21:19:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:46.028 21:19:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:46.028 21:19:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:46.028 21:19:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:46.028 21:19:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:46.028 21:19:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:46.028 21:19:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:46.028 21:19:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:46.028 21:19:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:46.028 21:19:40 -- common/autotest_common.sh@10 -- # set +x 00:18:51.301 21:19:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:51.301 21:19:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:51.301 21:19:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:51.301 21:19:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:51.301 21:19:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:51.301 21:19:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:51.301 21:19:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:51.301 21:19:44 -- nvmf/common.sh@295 -- # net_devs=() 00:18:51.301 21:19:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:51.301 21:19:44 -- nvmf/common.sh@296 -- # e810=() 00:18:51.301 21:19:44 -- nvmf/common.sh@296 -- # local -ga e810 00:18:51.301 21:19:44 -- nvmf/common.sh@297 -- # x722=() 00:18:51.301 21:19:44 -- nvmf/common.sh@297 -- # local -ga x722 00:18:51.301 21:19:44 -- nvmf/common.sh@298 -- # mlx=() 00:18:51.301 21:19:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:51.301 21:19:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:51.301 21:19:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:51.301 21:19:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:51.301 21:19:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:51.301 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:51.301 21:19:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:51.301 21:19:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:51.301 21:19:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:51.301 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:51.301 21:19:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:51.301 21:19:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:51.301 21:19:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:51.301 21:19:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:51.301 21:19:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:51.301 21:19:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:51.301 21:19:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:51.301 Found net devices under 0000:18:00.0: mlx_0_0 00:18:51.301 21:19:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:51.301 21:19:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:51.301 21:19:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:51.301 21:19:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:51.301 21:19:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:51.301 Found net devices under 0000:18:00.1: mlx_0_1 00:18:51.301 21:19:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:51.301 21:19:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:51.301 21:19:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:51.301 21:19:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:51.301 21:19:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:51.302 21:19:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:51.302 21:19:44 -- nvmf/common.sh@58 -- # uname 00:18:51.302 21:19:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:51.302 21:19:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:51.302 21:19:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:51.302 21:19:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:51.302 21:19:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:51.302 21:19:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:51.302 21:19:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:51.302 21:19:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:51.302 21:19:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:51.302 21:19:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:51.302 21:19:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:51.302 21:19:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:51.302 21:19:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:51.302 21:19:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:51.302 21:19:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:51.302 21:19:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:51.302 21:19:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@105 -- # continue 2 00:18:51.302 21:19:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@105 -- # continue 2 00:18:51.302 21:19:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:51.302 21:19:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.302 21:19:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:51.302 21:19:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:51.302 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:51.302 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:51.302 altname enp24s0f0np0 00:18:51.302 altname ens785f0np0 00:18:51.302 inet 192.168.100.8/24 scope global mlx_0_0 00:18:51.302 valid_lft forever preferred_lft forever 00:18:51.302 21:19:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:51.302 21:19:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.302 21:19:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:51.302 21:19:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:51.302 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:51.302 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:51.302 altname enp24s0f1np1 00:18:51.302 altname ens785f1np1 00:18:51.302 inet 192.168.100.9/24 scope global mlx_0_1 00:18:51.302 valid_lft forever preferred_lft forever 00:18:51.302 21:19:44 -- nvmf/common.sh@411 -- # return 0 00:18:51.302 21:19:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:51.302 21:19:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:51.302 21:19:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:51.302 21:19:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:51.302 21:19:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:51.302 21:19:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:51.302 21:19:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:51.302 21:19:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:51.302 21:19:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:51.302 21:19:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@105 -- # continue 2 00:18:51.302 21:19:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.302 21:19:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:51.302 21:19:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@105 -- # continue 2 00:18:51.302 21:19:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:51.302 21:19:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.302 21:19:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:51.302 21:19:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.302 21:19:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.302 21:19:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:51.302 192.168.100.9' 00:18:51.302 21:19:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:51.302 192.168.100.9' 00:18:51.302 21:19:44 -- nvmf/common.sh@446 -- # head -n 1 00:18:51.302 21:19:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:51.302 21:19:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:51.302 192.168.100.9' 00:18:51.302 21:19:44 -- nvmf/common.sh@447 -- # tail -n +2 00:18:51.302 21:19:44 -- nvmf/common.sh@447 -- # head -n 1 00:18:51.302 21:19:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:51.302 21:19:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:51.302 21:19:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:51.302 21:19:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:51.302 21:19:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:51.302 21:19:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:51.302 21:19:44 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:51.302 21:19:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:51.302 21:19:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:51.302 21:19:44 -- common/autotest_common.sh@10 -- # set +x 00:18:51.302 21:19:44 -- nvmf/common.sh@470 -- # nvmfpid=1357049 00:18:51.302 21:19:44 -- nvmf/common.sh@471 -- # waitforlisten 1357049 00:18:51.302 21:19:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:51.302 21:19:44 -- common/autotest_common.sh@817 -- # '[' -z 1357049 ']' 00:18:51.302 21:19:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:51.302 21:19:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:51.302 21:19:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:51.302 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:51.302 21:19:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:51.302 21:19:44 -- common/autotest_common.sh@10 -- # set +x 00:18:51.302 [2024-04-23 21:19:44.978898] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:51.302 [2024-04-23 21:19:44.978939] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:51.302 EAL: No free 2048 kB hugepages reported on node 1 00:18:51.302 [2024-04-23 21:19:45.030021] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:51.302 [2024-04-23 21:19:45.094025] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:51.302 [2024-04-23 21:19:45.094062] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:51.302 [2024-04-23 21:19:45.094068] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:51.302 [2024-04-23 21:19:45.094077] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:51.302 [2024-04-23 21:19:45.094082] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:51.302 [2024-04-23 21:19:45.094099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:51.561 21:19:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:51.561 21:19:45 -- common/autotest_common.sh@850 -- # return 0 00:18:51.561 21:19:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:51.561 21:19:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:51.561 21:19:45 -- common/autotest_common.sh@10 -- # set +x 00:18:51.561 21:19:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:51.561 21:19:45 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:18:51.561 21:19:45 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:18:51.561 Unsupported transport: rdma 00:18:51.561 21:19:45 -- target/zcopy.sh@17 -- # exit 0 00:18:51.561 21:19:45 -- target/zcopy.sh@1 -- # process_shm --id 0 00:18:51.561 21:19:45 -- common/autotest_common.sh@794 -- # type=--id 00:18:51.561 21:19:45 -- common/autotest_common.sh@795 -- # id=0 00:18:51.561 21:19:45 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:18:51.561 21:19:45 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:51.561 21:19:45 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:18:51.561 21:19:45 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:18:51.561 21:19:45 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:18:51.561 21:19:45 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:51.561 nvmf_trace.0 00:18:51.561 21:19:45 -- common/autotest_common.sh@809 -- # return 0 00:18:51.561 21:19:45 -- target/zcopy.sh@1 -- # nvmftestfini 00:18:51.561 21:19:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:51.561 21:19:45 -- nvmf/common.sh@117 -- # sync 00:18:51.561 21:19:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:51.561 21:19:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:51.561 21:19:45 -- nvmf/common.sh@120 -- # set +e 00:18:51.561 21:19:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:51.561 21:19:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:51.561 rmmod nvme_rdma 00:18:51.561 rmmod nvme_fabrics 00:18:51.820 21:19:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:51.820 21:19:45 -- nvmf/common.sh@124 -- # set -e 00:18:51.820 21:19:45 -- nvmf/common.sh@125 -- # return 0 00:18:51.820 21:19:45 -- nvmf/common.sh@478 -- # '[' -n 1357049 ']' 00:18:51.820 21:19:45 -- nvmf/common.sh@479 -- # killprocess 1357049 00:18:51.820 21:19:45 -- common/autotest_common.sh@936 -- # '[' -z 1357049 ']' 00:18:51.820 21:19:45 -- common/autotest_common.sh@940 -- # kill -0 1357049 00:18:51.820 21:19:45 -- common/autotest_common.sh@941 -- # uname 00:18:51.820 21:19:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.820 21:19:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1357049 00:18:51.820 21:19:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:51.820 21:19:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:51.820 21:19:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1357049' 00:18:51.820 killing process with pid 1357049 00:18:51.820 21:19:45 -- common/autotest_common.sh@955 -- # kill 1357049 00:18:51.820 21:19:45 -- common/autotest_common.sh@960 -- # wait 1357049 00:18:51.820 21:19:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:51.820 21:19:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:51.820 00:18:51.820 real 0m6.025s 00:18:51.820 user 0m2.589s 00:18:51.820 sys 0m3.831s 00:18:51.820 21:19:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:51.820 21:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:51.820 ************************************ 00:18:51.820 END TEST nvmf_zcopy 00:18:51.820 ************************************ 00:18:52.080 21:19:46 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:18:52.080 21:19:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:52.080 21:19:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:52.080 21:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:52.080 ************************************ 00:18:52.080 START TEST nvmf_nmic 00:18:52.080 ************************************ 00:18:52.080 21:19:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:18:52.080 * Looking for test storage... 00:18:52.080 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:52.080 21:19:46 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:52.080 21:19:46 -- nvmf/common.sh@7 -- # uname -s 00:18:52.080 21:19:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:52.080 21:19:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:52.080 21:19:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:52.080 21:19:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:52.080 21:19:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:52.080 21:19:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:52.080 21:19:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:52.080 21:19:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:52.080 21:19:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:52.080 21:19:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:52.080 21:19:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:52.080 21:19:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:52.080 21:19:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:52.080 21:19:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:52.080 21:19:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:52.080 21:19:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:52.080 21:19:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:52.080 21:19:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:52.080 21:19:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:52.080 21:19:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:52.080 21:19:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.080 21:19:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.080 21:19:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.080 21:19:46 -- paths/export.sh@5 -- # export PATH 00:18:52.339 21:19:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.339 21:19:46 -- nvmf/common.sh@47 -- # : 0 00:18:52.339 21:19:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:52.339 21:19:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:52.339 21:19:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:52.339 21:19:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:52.339 21:19:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:52.339 21:19:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:52.339 21:19:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:52.339 21:19:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:52.339 21:19:46 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:52.339 21:19:46 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:52.339 21:19:46 -- target/nmic.sh@14 -- # nvmftestinit 00:18:52.339 21:19:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:52.339 21:19:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:52.339 21:19:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:52.339 21:19:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:52.339 21:19:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:52.339 21:19:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.339 21:19:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.339 21:19:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.339 21:19:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:52.339 21:19:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:52.339 21:19:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:52.339 21:19:46 -- common/autotest_common.sh@10 -- # set +x 00:18:57.610 21:19:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.610 21:19:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:57.610 21:19:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:57.610 21:19:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:57.610 21:19:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:57.610 21:19:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:57.610 21:19:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:57.610 21:19:51 -- nvmf/common.sh@295 -- # net_devs=() 00:18:57.610 21:19:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:57.610 21:19:51 -- nvmf/common.sh@296 -- # e810=() 00:18:57.610 21:19:51 -- nvmf/common.sh@296 -- # local -ga e810 00:18:57.610 21:19:51 -- nvmf/common.sh@297 -- # x722=() 00:18:57.610 21:19:51 -- nvmf/common.sh@297 -- # local -ga x722 00:18:57.610 21:19:51 -- nvmf/common.sh@298 -- # mlx=() 00:18:57.610 21:19:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:57.610 21:19:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.610 21:19:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:57.610 21:19:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:57.610 21:19:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:57.610 21:19:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:57.610 21:19:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:57.610 21:19:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:57.610 21:19:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:57.610 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:57.610 21:19:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:57.610 21:19:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:57.610 21:19:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:57.610 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:57.610 21:19:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:57.610 21:19:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:57.610 21:19:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:57.610 21:19:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:57.610 21:19:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.611 21:19:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:57.611 21:19:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.611 21:19:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:57.611 Found net devices under 0000:18:00.0: mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.611 21:19:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.611 21:19:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:57.611 21:19:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.611 21:19:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:57.611 Found net devices under 0000:18:00.1: mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.611 21:19:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:57.611 21:19:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:57.611 21:19:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:57.611 21:19:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:57.611 21:19:51 -- nvmf/common.sh@58 -- # uname 00:18:57.611 21:19:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:57.611 21:19:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:57.611 21:19:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:57.611 21:19:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:57.611 21:19:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:57.611 21:19:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:57.611 21:19:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:57.611 21:19:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:57.611 21:19:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:57.611 21:19:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:57.611 21:19:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:57.611 21:19:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:57.611 21:19:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:57.611 21:19:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:57.611 21:19:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:57.611 21:19:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:57.611 21:19:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@105 -- # continue 2 00:18:57.611 21:19:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@105 -- # continue 2 00:18:57.611 21:19:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:57.611 21:19:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:57.611 21:19:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:57.611 21:19:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:57.611 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:57.611 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:57.611 altname enp24s0f0np0 00:18:57.611 altname ens785f0np0 00:18:57.611 inet 192.168.100.8/24 scope global mlx_0_0 00:18:57.611 valid_lft forever preferred_lft forever 00:18:57.611 21:19:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:57.611 21:19:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:57.611 21:19:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:57.611 21:19:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:57.611 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:57.611 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:57.611 altname enp24s0f1np1 00:18:57.611 altname ens785f1np1 00:18:57.611 inet 192.168.100.9/24 scope global mlx_0_1 00:18:57.611 valid_lft forever preferred_lft forever 00:18:57.611 21:19:51 -- nvmf/common.sh@411 -- # return 0 00:18:57.611 21:19:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:57.611 21:19:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:57.611 21:19:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:57.611 21:19:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:57.611 21:19:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:57.611 21:19:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:57.611 21:19:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:57.611 21:19:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:57.611 21:19:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:57.611 21:19:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@105 -- # continue 2 00:18:57.611 21:19:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:57.611 21:19:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:57.611 21:19:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@105 -- # continue 2 00:18:57.611 21:19:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:57.611 21:19:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:57.611 21:19:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:57.611 21:19:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:57.611 21:19:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:57.611 21:19:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:57.611 192.168.100.9' 00:18:57.611 21:19:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:57.611 192.168.100.9' 00:18:57.611 21:19:51 -- nvmf/common.sh@446 -- # head -n 1 00:18:57.611 21:19:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:57.611 21:19:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:57.611 192.168.100.9' 00:18:57.611 21:19:51 -- nvmf/common.sh@447 -- # tail -n +2 00:18:57.611 21:19:51 -- nvmf/common.sh@447 -- # head -n 1 00:18:57.611 21:19:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:57.611 21:19:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:57.611 21:19:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:57.611 21:19:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:57.611 21:19:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:57.611 21:19:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:57.611 21:19:51 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:57.611 21:19:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:57.611 21:19:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:57.611 21:19:51 -- common/autotest_common.sh@10 -- # set +x 00:18:57.611 21:19:51 -- nvmf/common.sh@470 -- # nvmfpid=1360639 00:18:57.611 21:19:51 -- nvmf/common.sh@471 -- # waitforlisten 1360639 00:18:57.611 21:19:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:57.611 21:19:51 -- common/autotest_common.sh@817 -- # '[' -z 1360639 ']' 00:18:57.611 21:19:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:57.611 21:19:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:57.611 21:19:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:57.611 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:57.611 21:19:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:57.611 21:19:51 -- common/autotest_common.sh@10 -- # set +x 00:18:57.611 [2024-04-23 21:19:51.811488] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:18:57.611 [2024-04-23 21:19:51.811527] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:57.611 EAL: No free 2048 kB hugepages reported on node 1 00:18:57.611 [2024-04-23 21:19:51.863030] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:57.870 [2024-04-23 21:19:51.933793] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:57.870 [2024-04-23 21:19:51.933826] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:57.870 [2024-04-23 21:19:51.933832] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:57.870 [2024-04-23 21:19:51.933838] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:57.870 [2024-04-23 21:19:51.933844] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:57.871 [2024-04-23 21:19:51.933881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:57.871 [2024-04-23 21:19:51.933961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:57.871 [2024-04-23 21:19:51.934045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:57.871 [2024-04-23 21:19:51.934046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:58.438 21:19:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:58.438 21:19:52 -- common/autotest_common.sh@850 -- # return 0 00:18:58.438 21:19:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:58.438 21:19:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:58.438 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.438 21:19:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:58.438 21:19:52 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:58.438 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.438 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.438 [2024-04-23 21:19:52.653390] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13996b0/0x139dba0) succeed. 00:18:58.438 [2024-04-23 21:19:52.662543] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x139acf0/0x13df230) succeed. 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 Malloc0 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 [2024-04-23 21:19:52.816598] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:58.697 test case1: single bdev can't be used in multiple subsystems 00:18:58.697 21:19:52 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@28 -- # nmic_status=0 00:18:58.697 21:19:52 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:58.697 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.697 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.697 [2024-04-23 21:19:52.840374] bdev.c:7988:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:58.697 [2024-04-23 21:19:52.840392] subsystem.c:1934:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:58.697 [2024-04-23 21:19:52.840398] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.697 request: 00:18:58.697 { 00:18:58.697 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:58.697 "namespace": { 00:18:58.697 "bdev_name": "Malloc0", 00:18:58.697 "no_auto_visible": false 00:18:58.697 }, 00:18:58.697 "method": "nvmf_subsystem_add_ns", 00:18:58.697 "req_id": 1 00:18:58.697 } 00:18:58.697 Got JSON-RPC error response 00:18:58.697 response: 00:18:58.697 { 00:18:58.697 "code": -32602, 00:18:58.697 "message": "Invalid parameters" 00:18:58.697 } 00:18:58.697 21:19:52 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:18:58.697 21:19:52 -- target/nmic.sh@29 -- # nmic_status=1 00:18:58.697 21:19:52 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:58.697 21:19:52 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:58.698 Adding namespace failed - expected result. 00:18:58.698 21:19:52 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:58.698 test case2: host connect to nvmf target in multiple paths 00:18:58.698 21:19:52 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:18:58.698 21:19:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:58.698 21:19:52 -- common/autotest_common.sh@10 -- # set +x 00:18:58.698 [2024-04-23 21:19:52.852450] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:18:58.698 21:19:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:58.698 21:19:52 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:18:59.635 21:19:53 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:19:00.652 21:19:54 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:00.652 21:19:54 -- common/autotest_common.sh@1184 -- # local i=0 00:19:00.652 21:19:54 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:00.652 21:19:54 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:19:00.652 21:19:54 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:02.564 21:19:56 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:02.564 21:19:56 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:02.564 21:19:56 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:02.564 21:19:56 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:19:02.564 21:19:56 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:02.564 21:19:56 -- common/autotest_common.sh@1194 -- # return 0 00:19:02.564 21:19:56 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:02.564 [global] 00:19:02.564 thread=1 00:19:02.564 invalidate=1 00:19:02.564 rw=write 00:19:02.564 time_based=1 00:19:02.564 runtime=1 00:19:02.564 ioengine=libaio 00:19:02.564 direct=1 00:19:02.564 bs=4096 00:19:02.564 iodepth=1 00:19:02.564 norandommap=0 00:19:02.564 numjobs=1 00:19:02.564 00:19:02.564 verify_dump=1 00:19:02.564 verify_backlog=512 00:19:02.564 verify_state_save=0 00:19:02.564 do_verify=1 00:19:02.564 verify=crc32c-intel 00:19:02.564 [job0] 00:19:02.564 filename=/dev/nvme0n1 00:19:02.822 Could not set queue depth (nvme0n1) 00:19:03.080 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:03.080 fio-3.35 00:19:03.080 Starting 1 thread 00:19:04.017 00:19:04.017 job0: (groupid=0, jobs=1): err= 0: pid=1361750: Tue Apr 23 21:19:58 2024 00:19:04.017 read: IOPS=7672, BW=30.0MiB/s (31.4MB/s)(30.0MiB/1001msec) 00:19:04.017 slat (nsec): min=6323, max=21918, avg=6939.82, stdev=610.09 00:19:04.017 clat (nsec): min=37235, max=75646, avg=54728.07, stdev=3389.87 00:19:04.017 lat (nsec): min=52823, max=82370, avg=61667.90, stdev=3419.20 00:19:04.017 clat percentiles (nsec): 00:19:04.017 | 1.00th=[47872], 5.00th=[49408], 10.00th=[50432], 20.00th=[51456], 00:19:04.017 | 30.00th=[52992], 40.00th=[54016], 50.00th=[54528], 60.00th=[55552], 00:19:04.017 | 70.00th=[56576], 80.00th=[57600], 90.00th=[59136], 95.00th=[60160], 00:19:04.017 | 99.00th=[62720], 99.50th=[63744], 99.90th=[67072], 99.95th=[70144], 00:19:04.017 | 99.99th=[75264] 00:19:04.017 write: IOPS=8104, BW=31.7MiB/s (33.2MB/s)(31.7MiB/1001msec); 0 zone resets 00:19:04.017 slat (nsec): min=7905, max=45852, avg=8740.13, stdev=892.85 00:19:04.017 clat (nsec): min=38067, max=87503, avg=52371.62, stdev=3605.51 00:19:04.017 lat (usec): min=51, max=133, avg=61.11, stdev= 3.75 00:19:04.017 clat percentiles (nsec): 00:19:04.017 | 1.00th=[45312], 5.00th=[46848], 10.00th=[47872], 20.00th=[48896], 00:19:04.017 | 30.00th=[50432], 40.00th=[51456], 50.00th=[52480], 60.00th=[53504], 00:19:04.017 | 70.00th=[54528], 80.00th=[55552], 90.00th=[57088], 95.00th=[58112], 00:19:04.017 | 99.00th=[61184], 99.50th=[62208], 99.90th=[65280], 99.95th=[67072], 00:19:04.017 | 99.99th=[87552] 00:19:04.017 bw ( KiB/s): min=32768, max=32768, per=100.00%, avg=32768.00, stdev= 0.00, samples=1 00:19:04.017 iops : min= 8192, max= 8192, avg=8192.00, stdev= 0.00, samples=1 00:19:04.017 lat (usec) : 50=18.60%, 100=81.40% 00:19:04.017 cpu : usr=8.40%, sys=16.70%, ctx=15793, majf=0, minf=2 00:19:04.017 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:04.017 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:04.017 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:04.017 issued rwts: total=7680,8113,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:04.017 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:04.017 00:19:04.017 Run status group 0 (all jobs): 00:19:04.017 READ: bw=30.0MiB/s (31.4MB/s), 30.0MiB/s-30.0MiB/s (31.4MB/s-31.4MB/s), io=30.0MiB (31.5MB), run=1001-1001msec 00:19:04.017 WRITE: bw=31.7MiB/s (33.2MB/s), 31.7MiB/s-31.7MiB/s (33.2MB/s-33.2MB/s), io=31.7MiB (33.2MB), run=1001-1001msec 00:19:04.017 00:19:04.017 Disk stats (read/write): 00:19:04.017 nvme0n1: ios=7074/7168, merge=0/0, ticks=342/320, in_queue=662, util=90.68% 00:19:04.017 21:19:58 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:06.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:06.550 21:20:00 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:06.550 21:20:00 -- common/autotest_common.sh@1205 -- # local i=0 00:19:06.550 21:20:00 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:06.550 21:20:00 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:06.550 21:20:00 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:06.550 21:20:00 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:06.550 21:20:00 -- common/autotest_common.sh@1217 -- # return 0 00:19:06.550 21:20:00 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:06.550 21:20:00 -- target/nmic.sh@53 -- # nvmftestfini 00:19:06.550 21:20:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:06.550 21:20:00 -- nvmf/common.sh@117 -- # sync 00:19:06.550 21:20:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:06.550 21:20:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:06.550 21:20:00 -- nvmf/common.sh@120 -- # set +e 00:19:06.550 21:20:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:06.550 21:20:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:06.550 rmmod nvme_rdma 00:19:06.550 rmmod nvme_fabrics 00:19:06.550 21:20:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:06.550 21:20:00 -- nvmf/common.sh@124 -- # set -e 00:19:06.550 21:20:00 -- nvmf/common.sh@125 -- # return 0 00:19:06.550 21:20:00 -- nvmf/common.sh@478 -- # '[' -n 1360639 ']' 00:19:06.550 21:20:00 -- nvmf/common.sh@479 -- # killprocess 1360639 00:19:06.551 21:20:00 -- common/autotest_common.sh@936 -- # '[' -z 1360639 ']' 00:19:06.551 21:20:00 -- common/autotest_common.sh@940 -- # kill -0 1360639 00:19:06.551 21:20:00 -- common/autotest_common.sh@941 -- # uname 00:19:06.551 21:20:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:06.551 21:20:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1360639 00:19:06.551 21:20:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:06.551 21:20:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:06.551 21:20:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1360639' 00:19:06.551 killing process with pid 1360639 00:19:06.551 21:20:00 -- common/autotest_common.sh@955 -- # kill 1360639 00:19:06.551 21:20:00 -- common/autotest_common.sh@960 -- # wait 1360639 00:19:06.551 [2024-04-23 21:20:00.425938] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:06.551 21:20:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:06.551 21:20:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:06.551 00:19:06.551 real 0m14.401s 00:19:06.551 user 0m43.667s 00:19:06.551 sys 0m4.923s 00:19:06.551 21:20:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:06.551 21:20:00 -- common/autotest_common.sh@10 -- # set +x 00:19:06.551 ************************************ 00:19:06.551 END TEST nvmf_nmic 00:19:06.551 ************************************ 00:19:06.551 21:20:00 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:06.551 21:20:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:06.551 21:20:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:06.551 21:20:00 -- common/autotest_common.sh@10 -- # set +x 00:19:06.551 ************************************ 00:19:06.551 START TEST nvmf_fio_target 00:19:06.551 ************************************ 00:19:06.551 21:20:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:06.810 * Looking for test storage... 00:19:06.810 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:06.810 21:20:00 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:06.810 21:20:00 -- nvmf/common.sh@7 -- # uname -s 00:19:06.810 21:20:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:06.810 21:20:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:06.810 21:20:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:06.810 21:20:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:06.810 21:20:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:06.810 21:20:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:06.810 21:20:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:06.810 21:20:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:06.810 21:20:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:06.810 21:20:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:06.810 21:20:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:06.810 21:20:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:06.810 21:20:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:06.810 21:20:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:06.810 21:20:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:06.810 21:20:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:06.810 21:20:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:06.810 21:20:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:06.810 21:20:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:06.810 21:20:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:06.810 21:20:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.810 21:20:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.810 21:20:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.810 21:20:00 -- paths/export.sh@5 -- # export PATH 00:19:06.810 21:20:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:06.810 21:20:00 -- nvmf/common.sh@47 -- # : 0 00:19:06.810 21:20:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:06.810 21:20:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:06.810 21:20:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:06.810 21:20:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:06.810 21:20:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:06.810 21:20:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:06.810 21:20:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:06.810 21:20:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:06.810 21:20:00 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:06.810 21:20:00 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:06.810 21:20:00 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:19:06.810 21:20:00 -- target/fio.sh@16 -- # nvmftestinit 00:19:06.810 21:20:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:06.810 21:20:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:06.810 21:20:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:06.810 21:20:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:06.810 21:20:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:06.810 21:20:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:06.810 21:20:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:06.810 21:20:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:06.810 21:20:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:06.810 21:20:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:06.810 21:20:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:06.810 21:20:00 -- common/autotest_common.sh@10 -- # set +x 00:19:12.084 21:20:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:12.084 21:20:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:12.084 21:20:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:12.084 21:20:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:12.084 21:20:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:12.084 21:20:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:12.084 21:20:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:12.084 21:20:06 -- nvmf/common.sh@295 -- # net_devs=() 00:19:12.084 21:20:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:12.084 21:20:06 -- nvmf/common.sh@296 -- # e810=() 00:19:12.084 21:20:06 -- nvmf/common.sh@296 -- # local -ga e810 00:19:12.084 21:20:06 -- nvmf/common.sh@297 -- # x722=() 00:19:12.084 21:20:06 -- nvmf/common.sh@297 -- # local -ga x722 00:19:12.084 21:20:06 -- nvmf/common.sh@298 -- # mlx=() 00:19:12.084 21:20:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:12.084 21:20:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:12.084 21:20:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:12.084 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:12.084 21:20:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:12.084 21:20:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:12.084 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:12.084 21:20:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:12.084 21:20:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.084 21:20:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.084 21:20:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:12.084 Found net devices under 0000:18:00.0: mlx_0_0 00:19:12.084 21:20:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.084 21:20:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.084 21:20:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:12.084 Found net devices under 0000:18:00.1: mlx_0_1 00:19:12.084 21:20:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.084 21:20:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:12.084 21:20:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:12.084 21:20:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:12.084 21:20:06 -- nvmf/common.sh@58 -- # uname 00:19:12.084 21:20:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:12.084 21:20:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:12.084 21:20:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:12.084 21:20:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:12.084 21:20:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:12.084 21:20:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:12.084 21:20:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:12.084 21:20:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:12.084 21:20:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:12.084 21:20:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:12.084 21:20:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:12.084 21:20:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:12.084 21:20:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:12.084 21:20:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:12.084 21:20:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:12.084 21:20:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:12.084 21:20:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:12.084 21:20:06 -- nvmf/common.sh@105 -- # continue 2 00:19:12.084 21:20:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.084 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:12.084 21:20:06 -- nvmf/common.sh@105 -- # continue 2 00:19:12.084 21:20:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:12.084 21:20:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:12.084 21:20:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:12.084 21:20:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:12.084 21:20:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:12.084 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:12.084 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:12.084 altname enp24s0f0np0 00:19:12.084 altname ens785f0np0 00:19:12.084 inet 192.168.100.8/24 scope global mlx_0_0 00:19:12.084 valid_lft forever preferred_lft forever 00:19:12.084 21:20:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:12.084 21:20:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:12.084 21:20:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:12.084 21:20:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:12.084 21:20:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:12.084 21:20:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:12.084 21:20:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:12.084 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:12.084 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:12.084 altname enp24s0f1np1 00:19:12.084 altname ens785f1np1 00:19:12.084 inet 192.168.100.9/24 scope global mlx_0_1 00:19:12.084 valid_lft forever preferred_lft forever 00:19:12.084 21:20:06 -- nvmf/common.sh@411 -- # return 0 00:19:12.084 21:20:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:12.084 21:20:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:12.085 21:20:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:12.085 21:20:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:12.085 21:20:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:12.085 21:20:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:12.085 21:20:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:12.085 21:20:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:12.085 21:20:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:12.085 21:20:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:12.085 21:20:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:12.085 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.085 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:12.085 21:20:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:12.085 21:20:06 -- nvmf/common.sh@105 -- # continue 2 00:19:12.085 21:20:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:12.085 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.085 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:12.085 21:20:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:12.085 21:20:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:12.085 21:20:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:12.085 21:20:06 -- nvmf/common.sh@105 -- # continue 2 00:19:12.085 21:20:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:12.085 21:20:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:12.085 21:20:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:12.085 21:20:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:12.085 21:20:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:12.085 21:20:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:12.085 21:20:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:12.085 21:20:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:12.085 192.168.100.9' 00:19:12.085 21:20:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:12.085 192.168.100.9' 00:19:12.085 21:20:06 -- nvmf/common.sh@446 -- # head -n 1 00:19:12.085 21:20:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:12.085 21:20:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:12.085 192.168.100.9' 00:19:12.085 21:20:06 -- nvmf/common.sh@447 -- # tail -n +2 00:19:12.085 21:20:06 -- nvmf/common.sh@447 -- # head -n 1 00:19:12.085 21:20:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:12.085 21:20:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:12.085 21:20:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:12.085 21:20:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:12.085 21:20:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:12.085 21:20:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:12.085 21:20:06 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:12.085 21:20:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:12.085 21:20:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:12.085 21:20:06 -- common/autotest_common.sh@10 -- # set +x 00:19:12.085 21:20:06 -- nvmf/common.sh@470 -- # nvmfpid=1365692 00:19:12.085 21:20:06 -- nvmf/common.sh@471 -- # waitforlisten 1365692 00:19:12.085 21:20:06 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:12.085 21:20:06 -- common/autotest_common.sh@817 -- # '[' -z 1365692 ']' 00:19:12.085 21:20:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:12.085 21:20:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:12.085 21:20:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:12.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:12.085 21:20:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:12.085 21:20:06 -- common/autotest_common.sh@10 -- # set +x 00:19:12.085 [2024-04-23 21:20:06.331926] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:19:12.085 [2024-04-23 21:20:06.331969] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:12.085 EAL: No free 2048 kB hugepages reported on node 1 00:19:12.345 [2024-04-23 21:20:06.381162] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:12.345 [2024-04-23 21:20:06.452095] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:12.345 [2024-04-23 21:20:06.452130] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:12.345 [2024-04-23 21:20:06.452137] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:12.345 [2024-04-23 21:20:06.452142] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:12.345 [2024-04-23 21:20:06.452147] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:12.345 [2024-04-23 21:20:06.452180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:12.345 [2024-04-23 21:20:06.452272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:12.345 [2024-04-23 21:20:06.452331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:12.345 [2024-04-23 21:20:06.452333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:12.912 21:20:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:12.912 21:20:07 -- common/autotest_common.sh@850 -- # return 0 00:19:12.912 21:20:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:12.913 21:20:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:12.913 21:20:07 -- common/autotest_common.sh@10 -- # set +x 00:19:12.913 21:20:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:12.913 21:20:07 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:13.171 [2024-04-23 21:20:07.303670] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1c336b0/0x1c37ba0) succeed. 00:19:13.171 [2024-04-23 21:20:07.312910] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1c34cf0/0x1c79230) succeed. 00:19:13.430 21:20:07 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:13.430 21:20:07 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:13.430 21:20:07 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:13.689 21:20:07 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:13.689 21:20:07 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:13.948 21:20:07 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:13.948 21:20:07 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:13.948 21:20:08 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:13.948 21:20:08 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:14.206 21:20:08 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:14.465 21:20:08 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:14.465 21:20:08 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:14.465 21:20:08 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:14.465 21:20:08 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:14.724 21:20:08 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:14.724 21:20:08 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:14.983 21:20:09 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:14.983 21:20:09 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:14.983 21:20:09 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:15.241 21:20:09 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:15.242 21:20:09 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:15.500 21:20:09 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:15.500 [2024-04-23 21:20:09.721441] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:15.500 21:20:09 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:15.759 21:20:09 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:16.018 21:20:10 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:16.955 21:20:11 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:16.955 21:20:11 -- common/autotest_common.sh@1184 -- # local i=0 00:19:16.955 21:20:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:16.955 21:20:11 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:19:16.955 21:20:11 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:19:16.955 21:20:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:18.857 21:20:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:18.857 21:20:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:18.857 21:20:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:18.857 21:20:13 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:19:18.857 21:20:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:18.857 21:20:13 -- common/autotest_common.sh@1194 -- # return 0 00:19:18.857 21:20:13 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:18.857 [global] 00:19:18.857 thread=1 00:19:18.857 invalidate=1 00:19:18.857 rw=write 00:19:18.857 time_based=1 00:19:18.857 runtime=1 00:19:18.857 ioengine=libaio 00:19:18.857 direct=1 00:19:18.857 bs=4096 00:19:18.857 iodepth=1 00:19:18.857 norandommap=0 00:19:18.857 numjobs=1 00:19:18.857 00:19:18.857 verify_dump=1 00:19:18.857 verify_backlog=512 00:19:18.857 verify_state_save=0 00:19:18.857 do_verify=1 00:19:18.857 verify=crc32c-intel 00:19:18.857 [job0] 00:19:18.857 filename=/dev/nvme0n1 00:19:18.857 [job1] 00:19:18.857 filename=/dev/nvme0n2 00:19:18.858 [job2] 00:19:18.858 filename=/dev/nvme0n3 00:19:18.858 [job3] 00:19:18.858 filename=/dev/nvme0n4 00:19:19.128 Could not set queue depth (nvme0n1) 00:19:19.128 Could not set queue depth (nvme0n2) 00:19:19.128 Could not set queue depth (nvme0n3) 00:19:19.128 Could not set queue depth (nvme0n4) 00:19:19.385 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.385 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.385 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.385 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.385 fio-3.35 00:19:19.385 Starting 4 threads 00:19:20.755 00:19:20.755 job0: (groupid=0, jobs=1): err= 0: pid=1367241: Tue Apr 23 21:20:14 2024 00:19:20.755 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:20.755 slat (nsec): min=6038, max=20956, avg=6778.40, stdev=642.52 00:19:20.755 clat (usec): min=59, max=171, avg=105.49, stdev=17.94 00:19:20.755 lat (usec): min=65, max=177, avg=112.27, stdev=17.99 00:19:20.755 clat percentiles (usec): 00:19:20.755 | 1.00th=[ 65], 5.00th=[ 70], 10.00th=[ 73], 20.00th=[ 96], 00:19:20.755 | 30.00th=[ 106], 40.00th=[ 110], 50.00th=[ 112], 60.00th=[ 114], 00:19:20.755 | 70.00th=[ 116], 80.00th=[ 118], 90.00th=[ 122], 95.00th=[ 125], 00:19:20.755 | 99.00th=[ 135], 99.50th=[ 143], 99.90th=[ 159], 99.95th=[ 163], 00:19:20.755 | 99.99th=[ 172] 00:19:20.755 write: IOPS=4535, BW=17.7MiB/s (18.6MB/s)(17.7MiB/1001msec); 0 zone resets 00:19:20.755 slat (nsec): min=7974, max=63865, avg=8895.45, stdev=1218.62 00:19:20.755 clat (usec): min=47, max=158, avg=106.15, stdev=10.17 00:19:20.755 lat (usec): min=56, max=175, avg=115.05, stdev=10.20 00:19:20.755 clat percentiles (usec): 00:19:20.755 | 1.00th=[ 68], 5.00th=[ 94], 10.00th=[ 99], 20.00th=[ 102], 00:19:20.755 | 30.00th=[ 104], 40.00th=[ 105], 50.00th=[ 108], 60.00th=[ 109], 00:19:20.755 | 70.00th=[ 111], 80.00th=[ 113], 90.00th=[ 116], 95.00th=[ 119], 00:19:20.755 | 99.00th=[ 133], 99.50th=[ 145], 99.90th=[ 153], 99.95th=[ 155], 00:19:20.755 | 99.99th=[ 159] 00:19:20.755 bw ( KiB/s): min=19168, max=19168, per=27.36%, avg=19168.00, stdev= 0.00, samples=1 00:19:20.755 iops : min= 4792, max= 4792, avg=4792.00, stdev= 0.00, samples=1 00:19:20.755 lat (usec) : 50=0.01%, 100=17.35%, 250=82.64% 00:19:20.755 cpu : usr=4.60%, sys=6.60%, ctx=8637, majf=0, minf=1 00:19:20.755 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:20.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.755 issued rwts: total=4096,4540,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.755 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:20.755 job1: (groupid=0, jobs=1): err= 0: pid=1367254: Tue Apr 23 21:20:14 2024 00:19:20.755 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:20.755 slat (nsec): min=6076, max=15740, avg=6785.32, stdev=622.82 00:19:20.755 clat (usec): min=63, max=325, avg=112.72, stdev=10.92 00:19:20.755 lat (usec): min=69, max=332, avg=119.50, stdev=10.90 00:19:20.755 clat percentiles (usec): 00:19:20.755 | 1.00th=[ 76], 5.00th=[ 101], 10.00th=[ 105], 20.00th=[ 109], 00:19:20.755 | 30.00th=[ 110], 40.00th=[ 112], 50.00th=[ 113], 60.00th=[ 115], 00:19:20.755 | 70.00th=[ 116], 80.00th=[ 118], 90.00th=[ 121], 95.00th=[ 126], 00:19:20.755 | 99.00th=[ 153], 99.50th=[ 159], 99.90th=[ 176], 99.95th=[ 186], 00:19:20.755 | 99.99th=[ 326] 00:19:20.755 write: IOPS=4375, BW=17.1MiB/s (17.9MB/s)(17.1MiB/1001msec); 0 zone resets 00:19:20.755 slat (nsec): min=6441, max=58666, avg=8884.77, stdev=1102.83 00:19:20.755 clat (usec): min=56, max=153, avg=103.61, stdev=10.77 00:19:20.755 lat (usec): min=65, max=164, avg=112.49, stdev=10.78 00:19:20.755 clat percentiles (usec): 00:19:20.755 | 1.00th=[ 69], 5.00th=[ 89], 10.00th=[ 96], 20.00th=[ 99], 00:19:20.755 | 30.00th=[ 101], 40.00th=[ 102], 50.00th=[ 104], 60.00th=[ 105], 00:19:20.756 | 70.00th=[ 108], 80.00th=[ 109], 90.00th=[ 113], 95.00th=[ 117], 00:19:20.756 | 99.00th=[ 141], 99.50th=[ 143], 99.90th=[ 151], 99.95th=[ 151], 00:19:20.756 | 99.99th=[ 153] 00:19:20.756 bw ( KiB/s): min=17384, max=17384, per=24.81%, avg=17384.00, stdev= 0.00, samples=1 00:19:20.756 iops : min= 4346, max= 4346, avg=4346.00, stdev= 0.00, samples=1 00:19:20.756 lat (usec) : 100=14.87%, 250=85.12%, 500=0.01% 00:19:20.756 cpu : usr=4.60%, sys=6.30%, ctx=8477, majf=0, minf=1 00:19:20.756 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:20.756 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 issued rwts: total=4096,4380,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.756 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:20.756 job2: (groupid=0, jobs=1): err= 0: pid=1367272: Tue Apr 23 21:20:14 2024 00:19:20.756 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:20.756 slat (nsec): min=6249, max=25988, avg=7160.24, stdev=959.38 00:19:20.756 clat (usec): min=76, max=530, avg=112.21, stdev=15.60 00:19:20.756 lat (usec): min=83, max=537, avg=119.37, stdev=15.61 00:19:20.756 clat percentiles (usec): 00:19:20.756 | 1.00th=[ 86], 5.00th=[ 92], 10.00th=[ 99], 20.00th=[ 106], 00:19:20.756 | 30.00th=[ 109], 40.00th=[ 111], 50.00th=[ 113], 60.00th=[ 115], 00:19:20.756 | 70.00th=[ 116], 80.00th=[ 119], 90.00th=[ 122], 95.00th=[ 126], 00:19:20.756 | 99.00th=[ 153], 99.50th=[ 190], 99.90th=[ 233], 99.95th=[ 297], 00:19:20.756 | 99.99th=[ 529] 00:19:20.756 write: IOPS=4231, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1001msec); 0 zone resets 00:19:20.756 slat (nsec): min=8311, max=35458, avg=9264.39, stdev=990.52 00:19:20.756 clat (usec): min=66, max=416, avg=107.25, stdev=15.40 00:19:20.756 lat (usec): min=76, max=425, avg=116.51, stdev=15.41 00:19:20.756 clat percentiles (usec): 00:19:20.756 | 1.00th=[ 81], 5.00th=[ 96], 10.00th=[ 99], 20.00th=[ 102], 00:19:20.756 | 30.00th=[ 103], 40.00th=[ 105], 50.00th=[ 106], 60.00th=[ 108], 00:19:20.756 | 70.00th=[ 110], 80.00th=[ 112], 90.00th=[ 115], 95.00th=[ 120], 00:19:20.756 | 99.00th=[ 157], 99.50th=[ 200], 99.90th=[ 306], 99.95th=[ 338], 00:19:20.756 | 99.99th=[ 416] 00:19:20.756 bw ( KiB/s): min=17416, max=17416, per=24.86%, avg=17416.00, stdev= 0.00, samples=1 00:19:20.756 iops : min= 4354, max= 4354, avg=4354.00, stdev= 0.00, samples=1 00:19:20.756 lat (usec) : 100=12.27%, 250=87.55%, 500=0.17%, 750=0.01% 00:19:20.756 cpu : usr=4.00%, sys=6.90%, ctx=8332, majf=0, minf=2 00:19:20.756 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:20.756 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 issued rwts: total=4096,4236,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.756 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:20.756 job3: (groupid=0, jobs=1): err= 0: pid=1367277: Tue Apr 23 21:20:14 2024 00:19:20.756 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:20.756 slat (nsec): min=6260, max=28059, avg=7013.02, stdev=801.39 00:19:20.756 clat (usec): min=67, max=260, avg=112.50, stdev= 8.92 00:19:20.756 lat (usec): min=74, max=267, avg=119.52, stdev= 8.91 00:19:20.756 clat percentiles (usec): 00:19:20.756 | 1.00th=[ 85], 5.00th=[ 102], 10.00th=[ 105], 20.00th=[ 108], 00:19:20.756 | 30.00th=[ 110], 40.00th=[ 112], 50.00th=[ 113], 60.00th=[ 114], 00:19:20.756 | 70.00th=[ 116], 80.00th=[ 118], 90.00th=[ 121], 95.00th=[ 125], 00:19:20.756 | 99.00th=[ 145], 99.50th=[ 149], 99.90th=[ 163], 99.95th=[ 167], 00:19:20.756 | 99.99th=[ 260] 00:19:20.756 write: IOPS=4374, BW=17.1MiB/s (17.9MB/s)(17.1MiB/1001msec); 0 zone resets 00:19:20.756 slat (nsec): min=8329, max=35550, avg=9273.75, stdev=1031.38 00:19:20.756 clat (usec): min=64, max=148, avg=103.17, stdev= 8.58 00:19:20.756 lat (usec): min=73, max=158, avg=112.45, stdev= 8.58 00:19:20.756 clat percentiles (usec): 00:19:20.756 | 1.00th=[ 76], 5.00th=[ 92], 10.00th=[ 96], 20.00th=[ 99], 00:19:20.756 | 30.00th=[ 101], 40.00th=[ 102], 50.00th=[ 103], 60.00th=[ 105], 00:19:20.756 | 70.00th=[ 106], 80.00th=[ 109], 90.00th=[ 112], 95.00th=[ 116], 00:19:20.756 | 99.00th=[ 131], 99.50th=[ 135], 99.90th=[ 145], 99.95th=[ 145], 00:19:20.756 | 99.99th=[ 149] 00:19:20.756 bw ( KiB/s): min=17376, max=17376, per=24.80%, avg=17376.00, stdev= 0.00, samples=1 00:19:20.756 iops : min= 4344, max= 4344, avg=4344.00, stdev= 0.00, samples=1 00:19:20.756 lat (usec) : 100=16.19%, 250=83.80%, 500=0.01% 00:19:20.756 cpu : usr=5.10%, sys=6.10%, ctx=8475, majf=0, minf=1 00:19:20.756 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:20.756 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.756 issued rwts: total=4096,4379,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.756 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:20.756 00:19:20.756 Run status group 0 (all jobs): 00:19:20.756 READ: bw=63.9MiB/s (67.0MB/s), 16.0MiB/s-16.0MiB/s (16.8MB/s-16.8MB/s), io=64.0MiB (67.1MB), run=1001-1001msec 00:19:20.756 WRITE: bw=68.4MiB/s (71.8MB/s), 16.5MiB/s-17.7MiB/s (17.3MB/s-18.6MB/s), io=68.5MiB (71.8MB), run=1001-1001msec 00:19:20.756 00:19:20.756 Disk stats (read/write): 00:19:20.756 nvme0n1: ios=3634/3888, merge=0/0, ticks=384/391, in_queue=775, util=87.37% 00:19:20.756 nvme0n2: ios=3599/3713, merge=0/0, ticks=390/375, in_queue=765, util=87.55% 00:19:20.756 nvme0n3: ios=3584/3629, merge=0/0, ticks=379/371, in_queue=750, util=89.26% 00:19:20.756 nvme0n4: ios=3584/3712, merge=0/0, ticks=394/351, in_queue=745, util=89.81% 00:19:20.756 21:20:14 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:20.756 [global] 00:19:20.756 thread=1 00:19:20.756 invalidate=1 00:19:20.756 rw=randwrite 00:19:20.756 time_based=1 00:19:20.756 runtime=1 00:19:20.756 ioengine=libaio 00:19:20.756 direct=1 00:19:20.756 bs=4096 00:19:20.756 iodepth=1 00:19:20.756 norandommap=0 00:19:20.756 numjobs=1 00:19:20.756 00:19:20.756 verify_dump=1 00:19:20.756 verify_backlog=512 00:19:20.756 verify_state_save=0 00:19:20.756 do_verify=1 00:19:20.756 verify=crc32c-intel 00:19:20.756 [job0] 00:19:20.756 filename=/dev/nvme0n1 00:19:20.756 [job1] 00:19:20.756 filename=/dev/nvme0n2 00:19:20.756 [job2] 00:19:20.756 filename=/dev/nvme0n3 00:19:20.756 [job3] 00:19:20.756 filename=/dev/nvme0n4 00:19:20.756 Could not set queue depth (nvme0n1) 00:19:20.756 Could not set queue depth (nvme0n2) 00:19:20.756 Could not set queue depth (nvme0n3) 00:19:20.756 Could not set queue depth (nvme0n4) 00:19:20.756 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:20.756 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:20.756 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:20.756 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:20.756 fio-3.35 00:19:20.756 Starting 4 threads 00:19:22.125 00:19:22.125 job0: (groupid=0, jobs=1): err= 0: pid=1367686: Tue Apr 23 21:20:16 2024 00:19:22.125 read: IOPS=3815, BW=14.9MiB/s (15.6MB/s)(14.9MiB/1001msec) 00:19:22.125 slat (nsec): min=6260, max=16515, avg=7068.23, stdev=592.94 00:19:22.125 clat (usec): min=65, max=346, avg=120.10, stdev=19.75 00:19:22.125 lat (usec): min=72, max=353, avg=127.17, stdev=19.74 00:19:22.125 clat percentiles (usec): 00:19:22.125 | 1.00th=[ 81], 5.00th=[ 99], 10.00th=[ 105], 20.00th=[ 112], 00:19:22.125 | 30.00th=[ 115], 40.00th=[ 117], 50.00th=[ 119], 60.00th=[ 122], 00:19:22.125 | 70.00th=[ 124], 80.00th=[ 127], 90.00th=[ 133], 95.00th=[ 143], 00:19:22.125 | 99.00th=[ 212], 99.50th=[ 243], 99.90th=[ 322], 99.95th=[ 347], 00:19:22.125 | 99.99th=[ 347] 00:19:22.125 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:22.125 slat (nsec): min=7712, max=62026, avg=8739.26, stdev=1131.14 00:19:22.125 clat (usec): min=62, max=342, avg=112.89, stdev=21.28 00:19:22.125 lat (usec): min=71, max=351, avg=121.63, stdev=21.30 00:19:22.125 clat percentiles (usec): 00:19:22.125 | 1.00th=[ 74], 5.00th=[ 89], 10.00th=[ 96], 20.00th=[ 102], 00:19:22.125 | 30.00th=[ 106], 40.00th=[ 109], 50.00th=[ 112], 60.00th=[ 114], 00:19:22.125 | 70.00th=[ 117], 80.00th=[ 120], 90.00th=[ 129], 95.00th=[ 145], 00:19:22.125 | 99.00th=[ 212], 99.50th=[ 243], 99.90th=[ 306], 99.95th=[ 322], 00:19:22.125 | 99.99th=[ 343] 00:19:22.125 bw ( KiB/s): min=16384, max=16384, per=20.70%, avg=16384.00, stdev= 0.00, samples=1 00:19:22.125 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:22.125 lat (usec) : 100=10.75%, 250=88.86%, 500=0.39% 00:19:22.126 cpu : usr=3.50%, sys=6.70%, ctx=7916, majf=0, minf=1 00:19:22.126 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 issued rwts: total=3819,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.126 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.126 job1: (groupid=0, jobs=1): err= 0: pid=1367695: Tue Apr 23 21:20:16 2024 00:19:22.126 read: IOPS=5626, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1001msec) 00:19:22.126 slat (nsec): min=6203, max=31135, avg=7040.84, stdev=729.51 00:19:22.126 clat (usec): min=61, max=262, avg=77.92, stdev=11.39 00:19:22.126 lat (usec): min=68, max=269, avg=84.96, stdev=11.46 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 67], 5.00th=[ 69], 10.00th=[ 71], 20.00th=[ 73], 00:19:22.126 | 30.00th=[ 74], 40.00th=[ 75], 50.00th=[ 77], 60.00th=[ 78], 00:19:22.126 | 70.00th=[ 80], 80.00th=[ 81], 90.00th=[ 85], 95.00th=[ 89], 00:19:22.126 | 99.00th=[ 135], 99.50th=[ 143], 99.90th=[ 161], 99.95th=[ 225], 00:19:22.126 | 99.99th=[ 265] 00:19:22.126 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1001msec); 0 zone resets 00:19:22.126 slat (nsec): min=7773, max=45118, avg=8812.97, stdev=1106.10 00:19:22.126 clat (usec): min=47, max=138, avg=72.37, stdev= 5.57 00:19:22.126 lat (usec): min=66, max=153, avg=81.18, stdev= 5.72 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 63], 5.00th=[ 65], 10.00th=[ 67], 20.00th=[ 69], 00:19:22.126 | 30.00th=[ 70], 40.00th=[ 71], 50.00th=[ 73], 60.00th=[ 74], 00:19:22.126 | 70.00th=[ 75], 80.00th=[ 77], 90.00th=[ 80], 95.00th=[ 82], 00:19:22.126 | 99.00th=[ 89], 99.50th=[ 91], 99.90th=[ 102], 99.95th=[ 110], 00:19:22.126 | 99.99th=[ 139] 00:19:22.126 bw ( KiB/s): min=24576, max=24576, per=31.05%, avg=24576.00, stdev= 0.00, samples=1 00:19:22.126 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=1 00:19:22.126 lat (usec) : 50=0.01%, 100=98.55%, 250=1.44%, 500=0.01% 00:19:22.126 cpu : usr=5.10%, sys=10.00%, ctx=11765, majf=0, minf=2 00:19:22.126 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 issued rwts: total=5632,6132,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.126 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.126 job2: (groupid=0, jobs=1): err= 0: pid=1367698: Tue Apr 23 21:20:16 2024 00:19:22.126 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:19:22.126 slat (nsec): min=6195, max=18867, avg=6954.98, stdev=709.75 00:19:22.126 clat (usec): min=68, max=265, avg=86.50, stdev= 7.35 00:19:22.126 lat (usec): min=74, max=273, avg=93.45, stdev= 7.38 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 75], 5.00th=[ 78], 10.00th=[ 79], 20.00th=[ 81], 00:19:22.126 | 30.00th=[ 83], 40.00th=[ 85], 50.00th=[ 86], 60.00th=[ 88], 00:19:22.126 | 70.00th=[ 90], 80.00th=[ 92], 90.00th=[ 95], 95.00th=[ 98], 00:19:22.126 | 99.00th=[ 105], 99.50th=[ 108], 99.90th=[ 116], 99.95th=[ 127], 00:19:22.126 | 99.99th=[ 265] 00:19:22.126 write: IOPS=5478, BW=21.4MiB/s (22.4MB/s)(21.4MiB/1001msec); 0 zone resets 00:19:22.126 slat (nsec): min=7854, max=39012, avg=8858.38, stdev=933.71 00:19:22.126 clat (usec): min=67, max=115, avg=82.25, stdev= 6.58 00:19:22.126 lat (usec): min=75, max=144, avg=91.11, stdev= 6.66 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 71], 5.00th=[ 73], 10.00th=[ 75], 20.00th=[ 77], 00:19:22.126 | 30.00th=[ 79], 40.00th=[ 81], 50.00th=[ 82], 60.00th=[ 84], 00:19:22.126 | 70.00th=[ 86], 80.00th=[ 88], 90.00th=[ 91], 95.00th=[ 95], 00:19:22.126 | 99.00th=[ 101], 99.50th=[ 104], 99.90th=[ 109], 99.95th=[ 110], 00:19:22.126 | 99.99th=[ 116] 00:19:22.126 bw ( KiB/s): min=21944, max=21944, per=27.72%, avg=21944.00, stdev= 0.00, samples=1 00:19:22.126 iops : min= 5486, max= 5486, avg=5486.00, stdev= 0.00, samples=1 00:19:22.126 lat (usec) : 100=97.76%, 250=2.24%, 500=0.01% 00:19:22.126 cpu : usr=4.80%, sys=9.00%, ctx=10604, majf=0, minf=1 00:19:22.126 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 issued rwts: total=5120,5484,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.126 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.126 job3: (groupid=0, jobs=1): err= 0: pid=1367699: Tue Apr 23 21:20:16 2024 00:19:22.126 read: IOPS=3748, BW=14.6MiB/s (15.4MB/s)(14.7MiB/1001msec) 00:19:22.126 slat (nsec): min=6240, max=29911, avg=7199.72, stdev=731.03 00:19:22.126 clat (usec): min=77, max=379, avg=121.07, stdev=19.44 00:19:22.126 lat (usec): min=84, max=385, avg=128.27, stdev=19.44 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 89], 5.00th=[ 103], 10.00th=[ 108], 20.00th=[ 112], 00:19:22.126 | 30.00th=[ 115], 40.00th=[ 117], 50.00th=[ 120], 60.00th=[ 122], 00:19:22.126 | 70.00th=[ 124], 80.00th=[ 127], 90.00th=[ 133], 95.00th=[ 145], 00:19:22.126 | 99.00th=[ 219], 99.50th=[ 253], 99.90th=[ 297], 99.95th=[ 367], 00:19:22.126 | 99.99th=[ 379] 00:19:22.126 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:22.126 slat (nsec): min=7798, max=35653, avg=9014.70, stdev=1009.95 00:19:22.126 clat (usec): min=70, max=382, avg=113.63, stdev=21.15 00:19:22.126 lat (usec): min=81, max=391, avg=122.64, stdev=21.18 00:19:22.126 clat percentiles (usec): 00:19:22.126 | 1.00th=[ 82], 5.00th=[ 94], 10.00th=[ 99], 20.00th=[ 103], 00:19:22.126 | 30.00th=[ 106], 40.00th=[ 109], 50.00th=[ 111], 60.00th=[ 114], 00:19:22.126 | 70.00th=[ 116], 80.00th=[ 120], 90.00th=[ 128], 95.00th=[ 141], 00:19:22.126 | 99.00th=[ 217], 99.50th=[ 255], 99.90th=[ 318], 99.95th=[ 355], 00:19:22.126 | 99.99th=[ 383] 00:19:22.126 bw ( KiB/s): min=16384, max=16384, per=20.70%, avg=16384.00, stdev= 0.00, samples=1 00:19:22.126 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:22.126 lat (usec) : 100=8.15%, 250=91.27%, 500=0.57% 00:19:22.126 cpu : usr=4.00%, sys=6.20%, ctx=7848, majf=0, minf=1 00:19:22.126 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.126 issued rwts: total=3752,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.126 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.126 00:19:22.126 Run status group 0 (all jobs): 00:19:22.126 READ: bw=71.5MiB/s (75.0MB/s), 14.6MiB/s-22.0MiB/s (15.4MB/s-23.0MB/s), io=71.6MiB (75.1MB), run=1001-1001msec 00:19:22.126 WRITE: bw=77.3MiB/s (81.1MB/s), 16.0MiB/s-23.9MiB/s (16.8MB/s-25.1MB/s), io=77.4MiB (81.1MB), run=1001-1001msec 00:19:22.126 00:19:22.126 Disk stats (read/write): 00:19:22.126 nvme0n1: ios=3264/3584, merge=0/0, ticks=382/385, in_queue=767, util=86.77% 00:19:22.126 nvme0n2: ios=5053/5120, merge=0/0, ticks=370/328, in_queue=698, util=87.20% 00:19:22.126 nvme0n3: ios=4473/4608, merge=0/0, ticks=359/367, in_queue=726, util=89.19% 00:19:22.126 nvme0n4: ios=3160/3584, merge=0/0, ticks=381/389, in_queue=770, util=89.75% 00:19:22.126 21:20:16 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:22.126 [global] 00:19:22.126 thread=1 00:19:22.126 invalidate=1 00:19:22.126 rw=write 00:19:22.126 time_based=1 00:19:22.126 runtime=1 00:19:22.126 ioengine=libaio 00:19:22.126 direct=1 00:19:22.126 bs=4096 00:19:22.126 iodepth=128 00:19:22.126 norandommap=0 00:19:22.126 numjobs=1 00:19:22.126 00:19:22.126 verify_dump=1 00:19:22.126 verify_backlog=512 00:19:22.126 verify_state_save=0 00:19:22.126 do_verify=1 00:19:22.126 verify=crc32c-intel 00:19:22.126 [job0] 00:19:22.126 filename=/dev/nvme0n1 00:19:22.126 [job1] 00:19:22.126 filename=/dev/nvme0n2 00:19:22.126 [job2] 00:19:22.126 filename=/dev/nvme0n3 00:19:22.126 [job3] 00:19:22.126 filename=/dev/nvme0n4 00:19:22.126 Could not set queue depth (nvme0n1) 00:19:22.126 Could not set queue depth (nvme0n2) 00:19:22.126 Could not set queue depth (nvme0n3) 00:19:22.126 Could not set queue depth (nvme0n4) 00:19:22.384 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:22.384 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:22.384 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:22.384 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:22.384 fio-3.35 00:19:22.384 Starting 4 threads 00:19:23.757 00:19:23.757 job0: (groupid=0, jobs=1): err= 0: pid=1368137: Tue Apr 23 21:20:17 2024 00:19:23.757 read: IOPS=6033, BW=23.6MiB/s (24.7MB/s)(23.6MiB/1003msec) 00:19:23.757 slat (nsec): min=1209, max=4759.1k, avg=81238.46, stdev=361288.82 00:19:23.757 clat (usec): min=772, max=19312, avg=10539.09, stdev=3470.58 00:19:23.757 lat (usec): min=779, max=19313, avg=10620.33, stdev=3491.65 00:19:23.757 clat percentiles (usec): 00:19:23.757 | 1.00th=[ 2507], 5.00th=[ 4293], 10.00th=[ 5997], 20.00th=[ 8029], 00:19:23.757 | 30.00th=[ 8455], 40.00th=[ 9241], 50.00th=[10421], 60.00th=[11600], 00:19:23.757 | 70.00th=[12256], 80.00th=[13829], 90.00th=[15533], 95.00th=[16057], 00:19:23.757 | 99.00th=[17171], 99.50th=[17171], 99.90th=[17433], 99.95th=[19268], 00:19:23.757 | 99.99th=[19268] 00:19:23.757 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:23.757 slat (nsec): min=1775, max=4592.5k, avg=78511.13, stdev=347592.52 00:19:23.757 clat (usec): min=2062, max=22302, avg=10305.23, stdev=3643.38 00:19:23.757 lat (usec): min=2515, max=22321, avg=10383.74, stdev=3658.49 00:19:23.757 clat percentiles (usec): 00:19:23.757 | 1.00th=[ 4080], 5.00th=[ 5014], 10.00th=[ 5997], 20.00th=[ 7504], 00:19:23.757 | 30.00th=[ 7963], 40.00th=[ 8356], 50.00th=[ 9503], 60.00th=[10945], 00:19:23.757 | 70.00th=[12256], 80.00th=[13698], 90.00th=[15270], 95.00th=[16057], 00:19:23.757 | 99.00th=[20841], 99.50th=[21103], 99.90th=[21890], 99.95th=[21890], 00:19:23.757 | 99.99th=[22414] 00:19:23.757 bw ( KiB/s): min=22016, max=27136, per=24.63%, avg=24576.00, stdev=3620.39, samples=2 00:19:23.757 iops : min= 5504, max= 6784, avg=6144.00, stdev=905.10, samples=2 00:19:23.757 lat (usec) : 1000=0.04% 00:19:23.757 lat (msec) : 2=0.13%, 4=1.76%, 10=48.12%, 20=49.21%, 50=0.73% 00:19:23.757 cpu : usr=1.90%, sys=4.09%, ctx=1893, majf=0, minf=1 00:19:23.757 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:23.757 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.757 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:23.757 issued rwts: total=6052,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.757 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:23.757 job1: (groupid=0, jobs=1): err= 0: pid=1368138: Tue Apr 23 21:20:17 2024 00:19:23.757 read: IOPS=6923, BW=27.0MiB/s (28.4MB/s)(27.1MiB/1003msec) 00:19:23.757 slat (nsec): min=1167, max=4169.6k, avg=70857.74, stdev=329091.06 00:19:23.757 clat (usec): min=895, max=22148, avg=9192.36, stdev=3410.30 00:19:23.757 lat (usec): min=2569, max=22151, avg=9263.22, stdev=3433.14 00:19:23.757 clat percentiles (usec): 00:19:23.757 | 1.00th=[ 3261], 5.00th=[ 4621], 10.00th=[ 5080], 20.00th=[ 6063], 00:19:23.757 | 30.00th=[ 6915], 40.00th=[ 7832], 50.00th=[ 8979], 60.00th=[ 9896], 00:19:23.757 | 70.00th=[11076], 80.00th=[11731], 90.00th=[14222], 95.00th=[15270], 00:19:23.757 | 99.00th=[17171], 99.50th=[17695], 99.90th=[22152], 99.95th=[22152], 00:19:23.757 | 99.99th=[22152] 00:19:23.757 write: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec); 0 zone resets 00:19:23.757 slat (nsec): min=1741, max=5070.2k, avg=68410.50, stdev=319416.26 00:19:23.757 clat (usec): min=2460, max=23183, avg=8803.30, stdev=3988.01 00:19:23.757 lat (usec): min=2463, max=23195, avg=8871.71, stdev=4010.11 00:19:23.757 clat percentiles (usec): 00:19:23.757 | 1.00th=[ 3130], 5.00th=[ 3818], 10.00th=[ 4490], 20.00th=[ 5080], 00:19:23.758 | 30.00th=[ 6063], 40.00th=[ 7177], 50.00th=[ 8455], 60.00th=[ 9503], 00:19:23.758 | 70.00th=[10421], 80.00th=[11207], 90.00th=[13698], 95.00th=[17433], 00:19:23.758 | 99.00th=[20841], 99.50th=[21103], 99.90th=[21365], 99.95th=[21627], 00:19:23.758 | 99.99th=[23200] 00:19:23.758 bw ( KiB/s): min=25368, max=31976, per=28.73%, avg=28672.00, stdev=4672.56, samples=2 00:19:23.758 iops : min= 6342, max= 7994, avg=7168.00, stdev=1168.14, samples=2 00:19:23.758 lat (usec) : 1000=0.01% 00:19:23.758 lat (msec) : 4=4.67%, 10=58.64%, 20=35.42%, 50=1.27% 00:19:23.758 cpu : usr=3.09%, sys=3.89%, ctx=2094, majf=0, minf=1 00:19:23.758 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:23.758 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.758 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:23.758 issued rwts: total=6944,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.758 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:23.758 job2: (groupid=0, jobs=1): err= 0: pid=1368139: Tue Apr 23 21:20:17 2024 00:19:23.758 read: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec) 00:19:23.758 slat (nsec): min=1251, max=4823.4k, avg=81609.80, stdev=347914.80 00:19:23.758 clat (usec): min=3314, max=19936, avg=10306.49, stdev=3575.27 00:19:23.758 lat (usec): min=3344, max=20919, avg=10388.10, stdev=3598.69 00:19:23.758 clat percentiles (usec): 00:19:23.758 | 1.00th=[ 4178], 5.00th=[ 5866], 10.00th=[ 6325], 20.00th=[ 7373], 00:19:23.758 | 30.00th=[ 7832], 40.00th=[ 8586], 50.00th=[ 9634], 60.00th=[10814], 00:19:23.758 | 70.00th=[11469], 80.00th=[12911], 90.00th=[15926], 95.00th=[17695], 00:19:23.758 | 99.00th=[19006], 99.50th=[19530], 99.90th=[19792], 99.95th=[20055], 00:19:23.758 | 99.99th=[20055] 00:19:23.758 write: IOPS=6572, BW=25.7MiB/s (26.9MB/s)(25.8MiB/1003msec); 0 zone resets 00:19:23.758 slat (nsec): min=1791, max=4773.3k, avg=73323.83, stdev=315897.76 00:19:23.758 clat (usec): min=829, max=19277, avg=9642.70, stdev=3046.00 00:19:23.758 lat (usec): min=2794, max=19304, avg=9716.03, stdev=3061.24 00:19:23.758 clat percentiles (usec): 00:19:23.758 | 1.00th=[ 3982], 5.00th=[ 5473], 10.00th=[ 5800], 20.00th=[ 6849], 00:19:23.758 | 30.00th=[ 7570], 40.00th=[ 8455], 50.00th=[ 9634], 60.00th=[10421], 00:19:23.758 | 70.00th=[11076], 80.00th=[12125], 90.00th=[13960], 95.00th=[15533], 00:19:23.758 | 99.00th=[16450], 99.50th=[17695], 99.90th=[18482], 99.95th=[19006], 00:19:23.758 | 99.99th=[19268] 00:19:23.758 bw ( KiB/s): min=24576, max=27136, per=25.91%, avg=25856.00, stdev=1810.19, samples=2 00:19:23.758 iops : min= 6144, max= 6784, avg=6464.00, stdev=452.55, samples=2 00:19:23.758 lat (usec) : 1000=0.01% 00:19:23.758 lat (msec) : 4=0.87%, 10=52.57%, 20=46.55% 00:19:23.758 cpu : usr=2.50%, sys=3.69%, ctx=1914, majf=0, minf=1 00:19:23.758 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:23.758 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.758 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:23.758 issued rwts: total=6144,6592,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.758 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:23.758 job3: (groupid=0, jobs=1): err= 0: pid=1368140: Tue Apr 23 21:20:17 2024 00:19:23.758 read: IOPS=4798, BW=18.7MiB/s (19.7MB/s)(18.8MiB/1002msec) 00:19:23.758 slat (nsec): min=1201, max=5686.0k, avg=101486.00, stdev=436006.19 00:19:23.758 clat (usec): min=938, max=27224, avg=12942.20, stdev=5330.27 00:19:23.758 lat (usec): min=944, max=27227, avg=13043.69, stdev=5361.04 00:19:23.758 clat percentiles (usec): 00:19:23.758 | 1.00th=[ 3359], 5.00th=[ 5342], 10.00th=[ 6915], 20.00th=[ 8094], 00:19:23.758 | 30.00th=[ 8848], 40.00th=[10421], 50.00th=[12649], 60.00th=[14615], 00:19:23.758 | 70.00th=[15795], 80.00th=[17957], 90.00th=[20841], 95.00th=[22414], 00:19:23.758 | 99.00th=[24249], 99.50th=[24773], 99.90th=[25297], 99.95th=[25297], 00:19:23.758 | 99.99th=[27132] 00:19:23.758 write: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec); 0 zone resets 00:19:23.758 slat (nsec): min=1805, max=5039.6k, avg=97257.09, stdev=370589.64 00:19:23.758 clat (usec): min=3564, max=24386, avg=12554.49, stdev=4417.31 00:19:23.758 lat (usec): min=3567, max=24388, avg=12651.75, stdev=4442.65 00:19:23.758 clat percentiles (usec): 00:19:23.758 | 1.00th=[ 5145], 5.00th=[ 6325], 10.00th=[ 7308], 20.00th=[ 8356], 00:19:23.758 | 30.00th=[ 9372], 40.00th=[10421], 50.00th=[11863], 60.00th=[13566], 00:19:23.758 | 70.00th=[15533], 80.00th=[16581], 90.00th=[19268], 95.00th=[20055], 00:19:23.758 | 99.00th=[21627], 99.50th=[21890], 99.90th=[22414], 99.95th=[22414], 00:19:23.758 | 99.99th=[24511] 00:19:23.758 bw ( KiB/s): min=16384, max=16384, per=16.42%, avg=16384.00, stdev= 0.00, samples=1 00:19:23.758 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:23.758 lat (usec) : 1000=0.05% 00:19:23.758 lat (msec) : 2=0.19%, 4=0.79%, 10=35.98%, 20=53.39%, 50=9.60% 00:19:23.758 cpu : usr=1.60%, sys=3.40%, ctx=1690, majf=0, minf=1 00:19:23.758 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:23.758 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.758 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:23.758 issued rwts: total=4808,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.758 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:23.758 00:19:23.758 Run status group 0 (all jobs): 00:19:23.758 READ: bw=93.3MiB/s (97.8MB/s), 18.7MiB/s-27.0MiB/s (19.7MB/s-28.4MB/s), io=93.5MiB (98.1MB), run=1002-1003msec 00:19:23.758 WRITE: bw=97.5MiB/s (102MB/s), 20.0MiB/s-27.9MiB/s (20.9MB/s-29.3MB/s), io=97.8MiB (102MB), run=1002-1003msec 00:19:23.758 00:19:23.758 Disk stats (read/write): 00:19:23.758 nvme0n1: ios=5034/5120, merge=0/0, ticks=18962/17943, in_queue=36905, util=83.07% 00:19:23.758 nvme0n2: ios=5632/5739, merge=0/0, ticks=17684/17159, in_queue=34843, util=83.88% 00:19:23.758 nvme0n3: ios=5384/5632, merge=0/0, ticks=16842/16996, in_queue=33838, util=87.42% 00:19:23.758 nvme0n4: ios=3636/4096, merge=0/0, ticks=14631/15717, in_queue=30348, util=89.19% 00:19:23.758 21:20:17 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:23.758 [global] 00:19:23.758 thread=1 00:19:23.758 invalidate=1 00:19:23.758 rw=randwrite 00:19:23.758 time_based=1 00:19:23.758 runtime=1 00:19:23.758 ioengine=libaio 00:19:23.758 direct=1 00:19:23.758 bs=4096 00:19:23.758 iodepth=128 00:19:23.758 norandommap=0 00:19:23.758 numjobs=1 00:19:23.758 00:19:23.758 verify_dump=1 00:19:23.758 verify_backlog=512 00:19:23.758 verify_state_save=0 00:19:23.758 do_verify=1 00:19:23.758 verify=crc32c-intel 00:19:23.758 [job0] 00:19:23.758 filename=/dev/nvme0n1 00:19:23.758 [job1] 00:19:23.758 filename=/dev/nvme0n2 00:19:23.758 [job2] 00:19:23.758 filename=/dev/nvme0n3 00:19:23.758 [job3] 00:19:23.758 filename=/dev/nvme0n4 00:19:23.758 Could not set queue depth (nvme0n1) 00:19:23.758 Could not set queue depth (nvme0n2) 00:19:23.758 Could not set queue depth (nvme0n3) 00:19:23.758 Could not set queue depth (nvme0n4) 00:19:24.016 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:24.016 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:24.016 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:24.016 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:24.016 fio-3.35 00:19:24.016 Starting 4 threads 00:19:25.394 00:19:25.394 job0: (groupid=0, jobs=1): err= 0: pid=1368556: Tue Apr 23 21:20:19 2024 00:19:25.394 read: IOPS=6182, BW=24.1MiB/s (25.3MB/s)(24.2MiB/1003msec) 00:19:25.394 slat (nsec): min=1186, max=4849.7k, avg=79620.39, stdev=361349.81 00:19:25.394 clat (usec): min=1879, max=23811, avg=10430.44, stdev=3891.50 00:19:25.394 lat (usec): min=2512, max=23822, avg=10510.06, stdev=3912.54 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 4080], 5.00th=[ 4883], 10.00th=[ 5342], 20.00th=[ 6587], 00:19:25.394 | 30.00th=[ 7898], 40.00th=[ 9372], 50.00th=[10683], 60.00th=[11469], 00:19:25.394 | 70.00th=[12125], 80.00th=[13173], 90.00th=[15139], 95.00th=[17957], 00:19:25.394 | 99.00th=[21365], 99.50th=[22938], 99.90th=[23462], 99.95th=[23725], 00:19:25.394 | 99.99th=[23725] 00:19:25.394 write: IOPS=6636, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1003msec); 0 zone resets 00:19:25.394 slat (nsec): min=1714, max=5604.5k, avg=72725.69, stdev=329717.86 00:19:25.394 clat (usec): min=3273, max=24703, avg=9364.31, stdev=3329.76 00:19:25.394 lat (usec): min=3354, max=24710, avg=9437.03, stdev=3347.84 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 4424], 5.00th=[ 4752], 10.00th=[ 4948], 20.00th=[ 6063], 00:19:25.394 | 30.00th=[ 7373], 40.00th=[ 8455], 50.00th=[ 9372], 60.00th=[10159], 00:19:25.394 | 70.00th=[11076], 80.00th=[11863], 90.00th=[13566], 95.00th=[14877], 00:19:25.394 | 99.00th=[19268], 99.50th=[20579], 99.90th=[24773], 99.95th=[24773], 00:19:25.394 | 99.99th=[24773] 00:19:25.394 bw ( KiB/s): min=24016, max=28672, per=25.52%, avg=26344.00, stdev=3292.29, samples=2 00:19:25.394 iops : min= 6004, max= 7168, avg=6586.00, stdev=823.07, samples=2 00:19:25.394 lat (msec) : 2=0.01%, 4=0.45%, 10=50.52%, 20=47.76%, 50=1.26% 00:19:25.394 cpu : usr=2.69%, sys=4.79%, ctx=1751, majf=0, minf=1 00:19:25.394 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:25.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.394 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:25.394 issued rwts: total=6201,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.394 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:25.394 job1: (groupid=0, jobs=1): err= 0: pid=1368557: Tue Apr 23 21:20:19 2024 00:19:25.394 read: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec) 00:19:25.394 slat (nsec): min=1164, max=4415.1k, avg=67291.60, stdev=314652.35 00:19:25.394 clat (usec): min=2209, max=20877, avg=8804.93, stdev=3732.97 00:19:25.394 lat (usec): min=2229, max=20879, avg=8872.23, stdev=3753.22 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 3523], 5.00th=[ 4228], 10.00th=[ 4686], 20.00th=[ 5407], 00:19:25.394 | 30.00th=[ 5997], 40.00th=[ 7111], 50.00th=[ 8291], 60.00th=[ 9241], 00:19:25.394 | 70.00th=[10552], 80.00th=[11731], 90.00th=[14091], 95.00th=[16319], 00:19:25.394 | 99.00th=[18744], 99.50th=[20579], 99.90th=[20841], 99.95th=[20841], 00:19:25.394 | 99.99th=[20841] 00:19:25.394 write: IOPS=7311, BW=28.6MiB/s (29.9MB/s)(28.6MiB/1003msec); 0 zone resets 00:19:25.394 slat (nsec): min=1643, max=4876.0k, avg=67695.41, stdev=301289.20 00:19:25.394 clat (usec): min=1268, max=19877, avg=8668.84, stdev=3736.15 00:19:25.394 lat (usec): min=2170, max=19880, avg=8736.54, stdev=3757.27 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 2933], 5.00th=[ 3916], 10.00th=[ 4228], 20.00th=[ 5080], 00:19:25.394 | 30.00th=[ 6063], 40.00th=[ 7111], 50.00th=[ 8356], 60.00th=[ 9503], 00:19:25.394 | 70.00th=[10290], 80.00th=[11338], 90.00th=[13566], 95.00th=[16450], 00:19:25.394 | 99.00th=[18744], 99.50th=[18744], 99.90th=[19792], 99.95th=[19792], 00:19:25.394 | 99.99th=[19792] 00:19:25.394 bw ( KiB/s): min=24576, max=33072, per=27.92%, avg=28824.00, stdev=6007.58, samples=2 00:19:25.394 iops : min= 6144, max= 8268, avg=7206.00, stdev=1501.89, samples=2 00:19:25.394 lat (msec) : 2=0.01%, 4=5.03%, 10=59.86%, 20=34.76%, 50=0.34% 00:19:25.394 cpu : usr=3.29%, sys=4.29%, ctx=1923, majf=0, minf=1 00:19:25.394 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:25.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.394 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:25.394 issued rwts: total=7168,7333,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.394 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:25.394 job2: (groupid=0, jobs=1): err= 0: pid=1368558: Tue Apr 23 21:20:19 2024 00:19:25.394 read: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec) 00:19:25.394 slat (nsec): min=1193, max=5003.7k, avg=79377.19, stdev=342060.43 00:19:25.394 clat (usec): min=3375, max=20074, avg=10414.43, stdev=3698.88 00:19:25.394 lat (usec): min=3377, max=20817, avg=10493.81, stdev=3718.99 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 4817], 5.00th=[ 5997], 10.00th=[ 6652], 20.00th=[ 7242], 00:19:25.394 | 30.00th=[ 7635], 40.00th=[ 8225], 50.00th=[ 9241], 60.00th=[10552], 00:19:25.394 | 70.00th=[12387], 80.00th=[13960], 90.00th=[16450], 95.00th=[17695], 00:19:25.394 | 99.00th=[18744], 99.50th=[19530], 99.90th=[19792], 99.95th=[19792], 00:19:25.394 | 99.99th=[20055] 00:19:25.394 write: IOPS=6249, BW=24.4MiB/s (25.6MB/s)(24.5MiB/1003msec); 0 zone resets 00:19:25.394 slat (nsec): min=1767, max=4860.7k, avg=78328.51, stdev=344501.24 00:19:25.394 clat (usec): min=2217, max=20500, avg=10027.37, stdev=3446.03 00:19:25.394 lat (usec): min=3468, max=21007, avg=10105.70, stdev=3461.42 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 4752], 5.00th=[ 5997], 10.00th=[ 6390], 20.00th=[ 6849], 00:19:25.394 | 30.00th=[ 7373], 40.00th=[ 7898], 50.00th=[ 9372], 60.00th=[11076], 00:19:25.394 | 70.00th=[11863], 80.00th=[12911], 90.00th=[15008], 95.00th=[16057], 00:19:25.394 | 99.00th=[18482], 99.50th=[19268], 99.90th=[20055], 99.95th=[20579], 00:19:25.394 | 99.99th=[20579] 00:19:25.394 bw ( KiB/s): min=23960, max=25232, per=23.82%, avg=24596.00, stdev=899.44, samples=2 00:19:25.394 iops : min= 5992, max= 6308, avg=6150.00, stdev=223.45, samples=2 00:19:25.394 lat (msec) : 4=0.36%, 10=54.94%, 20=44.64%, 50=0.06% 00:19:25.394 cpu : usr=1.80%, sys=5.49%, ctx=1646, majf=0, minf=1 00:19:25.394 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:25.394 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.394 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:25.394 issued rwts: total=6144,6268,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.394 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:25.394 job3: (groupid=0, jobs=1): err= 0: pid=1368559: Tue Apr 23 21:20:19 2024 00:19:25.394 read: IOPS=5465, BW=21.3MiB/s (22.4MB/s)(21.4MiB/1003msec) 00:19:25.394 slat (nsec): min=1197, max=4799.3k, avg=94745.54, stdev=422086.18 00:19:25.394 clat (usec): min=2254, max=19681, avg=11849.73, stdev=3717.10 00:19:25.394 lat (usec): min=2641, max=21743, avg=11944.47, stdev=3732.27 00:19:25.394 clat percentiles (usec): 00:19:25.394 | 1.00th=[ 5211], 5.00th=[ 6390], 10.00th=[ 7504], 20.00th=[ 8225], 00:19:25.394 | 30.00th=[ 9241], 40.00th=[10552], 50.00th=[11469], 60.00th=[12518], 00:19:25.394 | 70.00th=[14222], 80.00th=[15664], 90.00th=[17433], 95.00th=[17957], 00:19:25.394 | 99.00th=[19006], 99.50th=[19006], 99.90th=[19530], 99.95th=[19792], 00:19:25.395 | 99.99th=[19792] 00:19:25.395 write: IOPS=5615, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1003msec); 0 zone resets 00:19:25.395 slat (nsec): min=1725, max=4237.5k, avg=82028.16, stdev=366743.02 00:19:25.395 clat (usec): min=2975, max=19418, avg=10988.57, stdev=3838.70 00:19:25.395 lat (usec): min=3040, max=22155, avg=11070.60, stdev=3855.00 00:19:25.395 clat percentiles (usec): 00:19:25.395 | 1.00th=[ 4490], 5.00th=[ 5735], 10.00th=[ 6390], 20.00th=[ 7177], 00:19:25.395 | 30.00th=[ 8160], 40.00th=[ 9110], 50.00th=[10945], 60.00th=[11731], 00:19:25.395 | 70.00th=[12911], 80.00th=[14746], 90.00th=[17171], 95.00th=[17695], 00:19:25.395 | 99.00th=[18482], 99.50th=[19006], 99.90th=[19006], 99.95th=[19006], 00:19:25.395 | 99.99th=[19530] 00:19:25.395 bw ( KiB/s): min=21688, max=23368, per=21.82%, avg=22528.00, stdev=1187.94, samples=2 00:19:25.395 iops : min= 5422, max= 5842, avg=5632.00, stdev=296.98, samples=2 00:19:25.395 lat (msec) : 4=0.41%, 10=40.35%, 20=59.24% 00:19:25.395 cpu : usr=2.20%, sys=4.39%, ctx=1926, majf=0, minf=1 00:19:25.395 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:25.395 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:25.395 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:25.395 issued rwts: total=5482,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:25.395 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:25.395 00:19:25.395 Run status group 0 (all jobs): 00:19:25.395 READ: bw=97.3MiB/s (102MB/s), 21.3MiB/s-27.9MiB/s (22.4MB/s-29.3MB/s), io=97.6MiB (102MB), run=1003-1003msec 00:19:25.395 WRITE: bw=101MiB/s (106MB/s), 21.9MiB/s-28.6MiB/s (23.0MB/s-29.9MB/s), io=101MiB (106MB), run=1003-1003msec 00:19:25.395 00:19:25.395 Disk stats (read/write): 00:19:25.395 nvme0n1: ios=5673/5632, merge=0/0, ticks=15726/13171, in_queue=28897, util=86.37% 00:19:25.395 nvme0n2: ios=5566/5632, merge=0/0, ticks=16109/15760, in_queue=31869, util=86.63% 00:19:25.395 nvme0n3: ios=5230/5632, merge=0/0, ticks=14808/15669, in_queue=30477, util=88.76% 00:19:25.395 nvme0n4: ios=4800/5120, merge=0/0, ticks=15678/14985, in_queue=30663, util=89.54% 00:19:25.395 21:20:19 -- target/fio.sh@55 -- # sync 00:19:25.395 21:20:19 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:25.395 21:20:19 -- target/fio.sh@59 -- # fio_pid=1368823 00:19:25.395 21:20:19 -- target/fio.sh@61 -- # sleep 3 00:19:25.395 [global] 00:19:25.395 thread=1 00:19:25.395 invalidate=1 00:19:25.395 rw=read 00:19:25.395 time_based=1 00:19:25.395 runtime=10 00:19:25.395 ioengine=libaio 00:19:25.395 direct=1 00:19:25.395 bs=4096 00:19:25.395 iodepth=1 00:19:25.395 norandommap=1 00:19:25.395 numjobs=1 00:19:25.395 00:19:25.395 [job0] 00:19:25.395 filename=/dev/nvme0n1 00:19:25.395 [job1] 00:19:25.395 filename=/dev/nvme0n2 00:19:25.395 [job2] 00:19:25.395 filename=/dev/nvme0n3 00:19:25.395 [job3] 00:19:25.395 filename=/dev/nvme0n4 00:19:25.395 Could not set queue depth (nvme0n1) 00:19:25.395 Could not set queue depth (nvme0n2) 00:19:25.395 Could not set queue depth (nvme0n3) 00:19:25.395 Could not set queue depth (nvme0n4) 00:19:25.653 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:25.653 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:25.653 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:25.653 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:25.653 fio-3.35 00:19:25.653 Starting 4 threads 00:19:28.174 21:20:22 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:28.431 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=86528000, buflen=4096 00:19:28.431 fio: pid=1368987, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:28.431 21:20:22 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:28.431 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=91500544, buflen=4096 00:19:28.431 fio: pid=1368986, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:28.431 21:20:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:28.431 21:20:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:28.688 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=31461376, buflen=4096 00:19:28.688 fio: pid=1368984, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:28.688 21:20:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:28.688 21:20:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:28.945 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=44257280, buflen=4096 00:19:28.945 fio: pid=1368985, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:28.945 21:20:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:28.945 21:20:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:28.945 00:19:28.945 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1368984: Tue Apr 23 21:20:23 2024 00:19:28.945 read: IOPS=7950, BW=31.1MiB/s (32.6MB/s)(94.0MiB/3027msec) 00:19:28.945 slat (usec): min=5, max=22176, avg= 9.73, stdev=212.65 00:19:28.945 clat (usec): min=48, max=368, avg=114.57, stdev=18.08 00:19:28.945 lat (usec): min=55, max=22295, avg=124.31, stdev=213.34 00:19:28.945 clat percentiles (usec): 00:19:28.945 | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 82], 20.00th=[ 111], 00:19:28.945 | 30.00th=[ 114], 40.00th=[ 116], 50.00th=[ 118], 60.00th=[ 120], 00:19:28.945 | 70.00th=[ 122], 80.00th=[ 124], 90.00th=[ 130], 95.00th=[ 137], 00:19:28.945 | 99.00th=[ 157], 99.50th=[ 163], 99.90th=[ 176], 99.95th=[ 194], 00:19:28.945 | 99.99th=[ 326] 00:19:28.945 bw ( KiB/s): min=29632, max=31808, per=26.46%, avg=31300.80, stdev=938.76, samples=5 00:19:28.945 iops : min= 7408, max= 7952, avg=7825.20, stdev=234.69, samples=5 00:19:28.945 lat (usec) : 50=0.02%, 100=11.92%, 250=88.04%, 500=0.02% 00:19:28.945 cpu : usr=1.88%, sys=6.87%, ctx=24071, majf=0, minf=1 00:19:28.945 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 issued rwts: total=24066,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.945 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.945 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1368985: Tue Apr 23 21:20:23 2024 00:19:28.945 read: IOPS=8488, BW=33.2MiB/s (34.8MB/s)(106MiB/3203msec) 00:19:28.945 slat (usec): min=5, max=15914, avg= 9.32, stdev=159.39 00:19:28.945 clat (usec): min=38, max=901, avg=107.07, stdev=24.43 00:19:28.945 lat (usec): min=55, max=16010, avg=116.39, stdev=160.93 00:19:28.945 clat percentiles (usec): 00:19:28.945 | 1.00th=[ 53], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 82], 00:19:28.945 | 30.00th=[ 110], 40.00th=[ 113], 50.00th=[ 115], 60.00th=[ 117], 00:19:28.945 | 70.00th=[ 119], 80.00th=[ 122], 90.00th=[ 126], 95.00th=[ 135], 00:19:28.945 | 99.00th=[ 155], 99.50th=[ 159], 99.90th=[ 184], 99.95th=[ 210], 00:19:28.945 | 99.99th=[ 371] 00:19:28.945 bw ( KiB/s): min=31632, max=39106, per=28.08%, avg=33212.33, stdev=2894.63, samples=6 00:19:28.945 iops : min= 7908, max= 9776, avg=8303.00, stdev=723.45, samples=6 00:19:28.945 lat (usec) : 50=0.11%, 100=21.97%, 250=77.88%, 500=0.03%, 1000=0.01% 00:19:28.945 cpu : usr=1.75%, sys=7.53%, ctx=27196, majf=0, minf=1 00:19:28.945 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 issued rwts: total=27190,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.945 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.945 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1368986: Tue Apr 23 21:20:23 2024 00:19:28.945 read: IOPS=7827, BW=30.6MiB/s (32.1MB/s)(87.3MiB/2854msec) 00:19:28.945 slat (usec): min=6, max=13885, avg= 8.31, stdev=106.79 00:19:28.945 clat (usec): min=57, max=320, avg=117.94, stdev=12.20 00:19:28.945 lat (usec): min=70, max=13985, avg=126.24, stdev=107.36 00:19:28.945 clat percentiles (usec): 00:19:28.945 | 1.00th=[ 79], 5.00th=[ 101], 10.00th=[ 109], 20.00th=[ 113], 00:19:28.945 | 30.00th=[ 115], 40.00th=[ 117], 50.00th=[ 118], 60.00th=[ 120], 00:19:28.945 | 70.00th=[ 122], 80.00th=[ 124], 90.00th=[ 131], 95.00th=[ 139], 00:19:28.945 | 99.00th=[ 153], 99.50th=[ 157], 99.90th=[ 176], 99.95th=[ 194], 00:19:28.945 | 99.99th=[ 314] 00:19:28.945 bw ( KiB/s): min=29632, max=31808, per=26.46%, avg=31296.00, stdev=936.09, samples=5 00:19:28.945 iops : min= 7408, max= 7952, avg=7824.00, stdev=234.02, samples=5 00:19:28.945 lat (usec) : 100=4.79%, 250=95.18%, 500=0.03% 00:19:28.945 cpu : usr=2.28%, sys=6.48%, ctx=22342, majf=0, minf=1 00:19:28.945 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 issued rwts: total=22340,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.945 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.945 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1368987: Tue Apr 23 21:20:23 2024 00:19:28.945 read: IOPS=7841, BW=30.6MiB/s (32.1MB/s)(82.5MiB/2694msec) 00:19:28.945 slat (nsec): min=6060, max=69752, avg=7132.52, stdev=919.40 00:19:28.945 clat (usec): min=71, max=949, avg=118.07, stdev=13.04 00:19:28.945 lat (usec): min=78, max=956, avg=125.20, stdev=13.12 00:19:28.945 clat percentiles (usec): 00:19:28.945 | 1.00th=[ 90], 5.00th=[ 108], 10.00th=[ 110], 20.00th=[ 113], 00:19:28.945 | 30.00th=[ 115], 40.00th=[ 116], 50.00th=[ 117], 60.00th=[ 119], 00:19:28.945 | 70.00th=[ 121], 80.00th=[ 123], 90.00th=[ 130], 95.00th=[ 137], 00:19:28.945 | 99.00th=[ 153], 99.50th=[ 157], 99.90th=[ 169], 99.95th=[ 204], 00:19:28.945 | 99.99th=[ 545] 00:19:28.945 bw ( KiB/s): min=29832, max=32216, per=26.78%, avg=31672.00, stdev=1030.03, samples=5 00:19:28.945 iops : min= 7458, max= 8054, avg=7918.00, stdev=257.51, samples=5 00:19:28.945 lat (usec) : 100=2.00%, 250=97.96%, 500=0.02%, 750=0.01%, 1000=0.01% 00:19:28.945 cpu : usr=2.27%, sys=6.39%, ctx=21126, majf=0, minf=2 00:19:28.945 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:28.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.945 issued rwts: total=21126,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.945 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:28.945 00:19:28.945 Run status group 0 (all jobs): 00:19:28.945 READ: bw=116MiB/s (121MB/s), 30.6MiB/s-33.2MiB/s (32.1MB/s-34.8MB/s), io=370MiB (388MB), run=2694-3203msec 00:19:28.945 00:19:28.945 Disk stats (read/write): 00:19:28.945 nvme0n1: ios=22546/0, merge=0/0, ticks=2565/0, in_queue=2565, util=94.82% 00:19:28.945 nvme0n2: ios=26014/0, merge=0/0, ticks=2746/0, in_queue=2746, util=94.62% 00:19:28.945 nvme0n3: ios=20458/0, merge=0/0, ticks=2369/0, in_queue=2369, util=96.25% 00:19:28.945 nvme0n4: ios=20711/0, merge=0/0, ticks=2361/0, in_queue=2361, util=96.46% 00:19:29.202 21:20:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:29.202 21:20:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:29.202 21:20:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:29.202 21:20:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:29.459 21:20:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:29.459 21:20:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:29.716 21:20:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:29.716 21:20:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:29.716 21:20:23 -- target/fio.sh@69 -- # fio_status=0 00:19:29.716 21:20:23 -- target/fio.sh@70 -- # wait 1368823 00:19:29.716 21:20:23 -- target/fio.sh@70 -- # fio_status=4 00:19:29.716 21:20:23 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:30.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:30.647 21:20:24 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:30.647 21:20:24 -- common/autotest_common.sh@1205 -- # local i=0 00:19:30.647 21:20:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:30.647 21:20:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:30.647 21:20:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:30.647 21:20:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:30.647 21:20:24 -- common/autotest_common.sh@1217 -- # return 0 00:19:30.647 21:20:24 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:30.647 21:20:24 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:30.647 nvmf hotplug test: fio failed as expected 00:19:30.647 21:20:24 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:30.904 21:20:25 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:30.904 21:20:25 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:30.904 21:20:25 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:30.904 21:20:25 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:30.904 21:20:25 -- target/fio.sh@91 -- # nvmftestfini 00:19:30.904 21:20:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:30.904 21:20:25 -- nvmf/common.sh@117 -- # sync 00:19:30.904 21:20:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:30.904 21:20:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:30.904 21:20:25 -- nvmf/common.sh@120 -- # set +e 00:19:30.904 21:20:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:30.904 21:20:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:30.904 rmmod nvme_rdma 00:19:30.904 rmmod nvme_fabrics 00:19:30.904 21:20:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:30.904 21:20:25 -- nvmf/common.sh@124 -- # set -e 00:19:30.904 21:20:25 -- nvmf/common.sh@125 -- # return 0 00:19:30.904 21:20:25 -- nvmf/common.sh@478 -- # '[' -n 1365692 ']' 00:19:30.904 21:20:25 -- nvmf/common.sh@479 -- # killprocess 1365692 00:19:30.904 21:20:25 -- common/autotest_common.sh@936 -- # '[' -z 1365692 ']' 00:19:30.904 21:20:25 -- common/autotest_common.sh@940 -- # kill -0 1365692 00:19:30.904 21:20:25 -- common/autotest_common.sh@941 -- # uname 00:19:30.904 21:20:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:30.904 21:20:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1365692 00:19:30.904 21:20:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:31.162 21:20:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:31.162 21:20:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1365692' 00:19:31.162 killing process with pid 1365692 00:19:31.162 21:20:25 -- common/autotest_common.sh@955 -- # kill 1365692 00:19:31.162 21:20:25 -- common/autotest_common.sh@960 -- # wait 1365692 00:19:31.162 [2024-04-23 21:20:25.252884] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:31.419 21:20:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:31.419 21:20:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:31.419 00:19:31.419 real 0m24.665s 00:19:31.419 user 2m1.941s 00:19:31.419 sys 0m8.146s 00:19:31.419 21:20:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:31.419 21:20:25 -- common/autotest_common.sh@10 -- # set +x 00:19:31.419 ************************************ 00:19:31.419 END TEST nvmf_fio_target 00:19:31.419 ************************************ 00:19:31.419 21:20:25 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:31.419 21:20:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:31.419 21:20:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:31.419 21:20:25 -- common/autotest_common.sh@10 -- # set +x 00:19:31.419 ************************************ 00:19:31.419 START TEST nvmf_bdevio 00:19:31.419 ************************************ 00:19:31.419 21:20:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:31.419 * Looking for test storage... 00:19:31.676 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:31.677 21:20:25 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:31.677 21:20:25 -- nvmf/common.sh@7 -- # uname -s 00:19:31.677 21:20:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:31.677 21:20:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:31.677 21:20:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:31.677 21:20:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:31.677 21:20:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:31.677 21:20:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:31.677 21:20:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:31.677 21:20:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:31.677 21:20:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:31.677 21:20:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:31.677 21:20:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:31.677 21:20:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:31.677 21:20:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:31.677 21:20:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:31.677 21:20:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:31.677 21:20:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:31.677 21:20:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:31.677 21:20:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:31.677 21:20:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:31.677 21:20:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:31.677 21:20:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.677 21:20:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.677 21:20:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.677 21:20:25 -- paths/export.sh@5 -- # export PATH 00:19:31.677 21:20:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:31.677 21:20:25 -- nvmf/common.sh@47 -- # : 0 00:19:31.677 21:20:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:31.677 21:20:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:31.677 21:20:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:31.677 21:20:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:31.677 21:20:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:31.677 21:20:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:31.677 21:20:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:31.677 21:20:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:31.677 21:20:25 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:31.677 21:20:25 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:31.677 21:20:25 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:31.677 21:20:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:31.677 21:20:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:31.677 21:20:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:31.677 21:20:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:31.677 21:20:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:31.677 21:20:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:31.677 21:20:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:31.677 21:20:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:31.677 21:20:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:31.677 21:20:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:31.677 21:20:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:31.677 21:20:25 -- common/autotest_common.sh@10 -- # set +x 00:19:37.033 21:20:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:37.033 21:20:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:37.033 21:20:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:37.033 21:20:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:37.033 21:20:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:37.033 21:20:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:37.033 21:20:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:37.033 21:20:31 -- nvmf/common.sh@295 -- # net_devs=() 00:19:37.033 21:20:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:37.033 21:20:31 -- nvmf/common.sh@296 -- # e810=() 00:19:37.033 21:20:31 -- nvmf/common.sh@296 -- # local -ga e810 00:19:37.033 21:20:31 -- nvmf/common.sh@297 -- # x722=() 00:19:37.033 21:20:31 -- nvmf/common.sh@297 -- # local -ga x722 00:19:37.033 21:20:31 -- nvmf/common.sh@298 -- # mlx=() 00:19:37.033 21:20:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:37.033 21:20:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:37.033 21:20:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:37.033 21:20:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:37.033 21:20:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:37.033 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:37.033 21:20:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:37.033 21:20:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:37.033 21:20:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:37.033 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:37.033 21:20:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:37.033 21:20:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:37.033 21:20:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:37.033 21:20:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.033 21:20:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:37.033 21:20:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.033 21:20:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:37.033 Found net devices under 0000:18:00.0: mlx_0_0 00:19:37.033 21:20:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:37.033 21:20:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.033 21:20:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:37.033 21:20:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.033 21:20:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:37.033 Found net devices under 0000:18:00.1: mlx_0_1 00:19:37.033 21:20:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.033 21:20:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:37.033 21:20:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:37.033 21:20:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:37.033 21:20:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:37.033 21:20:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:37.033 21:20:31 -- nvmf/common.sh@58 -- # uname 00:19:37.033 21:20:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:37.033 21:20:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:37.033 21:20:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:37.033 21:20:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:37.033 21:20:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:37.033 21:20:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:37.033 21:20:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:37.033 21:20:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:37.033 21:20:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:37.033 21:20:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:37.033 21:20:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:37.033 21:20:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:37.034 21:20:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:37.034 21:20:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:37.034 21:20:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:37.034 21:20:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:37.034 21:20:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@105 -- # continue 2 00:19:37.034 21:20:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@105 -- # continue 2 00:19:37.034 21:20:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:37.034 21:20:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:37.034 21:20:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:37.034 21:20:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:37.034 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:37.034 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:37.034 altname enp24s0f0np0 00:19:37.034 altname ens785f0np0 00:19:37.034 inet 192.168.100.8/24 scope global mlx_0_0 00:19:37.034 valid_lft forever preferred_lft forever 00:19:37.034 21:20:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:37.034 21:20:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:37.034 21:20:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:37.034 21:20:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:37.034 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:37.034 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:37.034 altname enp24s0f1np1 00:19:37.034 altname ens785f1np1 00:19:37.034 inet 192.168.100.9/24 scope global mlx_0_1 00:19:37.034 valid_lft forever preferred_lft forever 00:19:37.034 21:20:31 -- nvmf/common.sh@411 -- # return 0 00:19:37.034 21:20:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:37.034 21:20:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:37.034 21:20:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:37.034 21:20:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:37.034 21:20:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:37.034 21:20:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:37.034 21:20:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:37.034 21:20:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:37.034 21:20:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:37.034 21:20:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@105 -- # continue 2 00:19:37.034 21:20:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:37.034 21:20:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:37.034 21:20:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@105 -- # continue 2 00:19:37.034 21:20:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:37.034 21:20:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:37.034 21:20:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:37.034 21:20:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:37.034 21:20:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:37.034 21:20:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:37.034 192.168.100.9' 00:19:37.034 21:20:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:37.034 192.168.100.9' 00:19:37.034 21:20:31 -- nvmf/common.sh@446 -- # head -n 1 00:19:37.034 21:20:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:37.034 21:20:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:37.034 192.168.100.9' 00:19:37.034 21:20:31 -- nvmf/common.sh@447 -- # tail -n +2 00:19:37.034 21:20:31 -- nvmf/common.sh@447 -- # head -n 1 00:19:37.034 21:20:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:37.034 21:20:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:37.034 21:20:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:37.034 21:20:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:37.034 21:20:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:37.034 21:20:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:37.034 21:20:31 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:37.034 21:20:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:37.034 21:20:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:37.034 21:20:31 -- common/autotest_common.sh@10 -- # set +x 00:19:37.034 21:20:31 -- nvmf/common.sh@470 -- # nvmfpid=1373405 00:19:37.034 21:20:31 -- nvmf/common.sh@471 -- # waitforlisten 1373405 00:19:37.034 21:20:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:37.034 21:20:31 -- common/autotest_common.sh@817 -- # '[' -z 1373405 ']' 00:19:37.034 21:20:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:37.034 21:20:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:37.034 21:20:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:37.034 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:37.034 21:20:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:37.034 21:20:31 -- common/autotest_common.sh@10 -- # set +x 00:19:37.034 [2024-04-23 21:20:31.266627] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:19:37.034 [2024-04-23 21:20:31.266672] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:37.034 EAL: No free 2048 kB hugepages reported on node 1 00:19:37.292 [2024-04-23 21:20:31.319792] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:37.292 [2024-04-23 21:20:31.389669] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:37.292 [2024-04-23 21:20:31.389705] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:37.292 [2024-04-23 21:20:31.389711] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:37.292 [2024-04-23 21:20:31.389716] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:37.292 [2024-04-23 21:20:31.389721] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:37.292 [2024-04-23 21:20:31.389817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:37.292 [2024-04-23 21:20:31.389925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:37.292 [2024-04-23 21:20:31.390009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:37.292 [2024-04-23 21:20:31.390011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:37.857 21:20:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:37.857 21:20:32 -- common/autotest_common.sh@850 -- # return 0 00:19:37.857 21:20:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:37.857 21:20:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:37.857 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:37.857 21:20:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:37.857 21:20:32 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:37.857 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:37.857 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:37.857 [2024-04-23 21:20:32.112831] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xacef90/0xad3480) succeed. 00:19:37.857 [2024-04-23 21:20:32.122117] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xad05d0/0xb14b10) succeed. 00:19:38.115 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.115 21:20:32 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:38.115 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:38.115 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:38.115 Malloc0 00:19:38.115 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.115 21:20:32 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:38.115 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:38.115 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:38.115 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.115 21:20:32 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:38.115 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:38.115 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:38.115 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.115 21:20:32 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:38.115 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:38.115 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:38.115 [2024-04-23 21:20:32.275973] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:38.115 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.115 21:20:32 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:38.115 21:20:32 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:38.115 21:20:32 -- nvmf/common.sh@521 -- # config=() 00:19:38.115 21:20:32 -- nvmf/common.sh@521 -- # local subsystem config 00:19:38.115 21:20:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:38.115 21:20:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:38.115 { 00:19:38.115 "params": { 00:19:38.115 "name": "Nvme$subsystem", 00:19:38.115 "trtype": "$TEST_TRANSPORT", 00:19:38.115 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:38.115 "adrfam": "ipv4", 00:19:38.115 "trsvcid": "$NVMF_PORT", 00:19:38.115 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:38.115 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:38.115 "hdgst": ${hdgst:-false}, 00:19:38.115 "ddgst": ${ddgst:-false} 00:19:38.115 }, 00:19:38.115 "method": "bdev_nvme_attach_controller" 00:19:38.115 } 00:19:38.115 EOF 00:19:38.115 )") 00:19:38.115 21:20:32 -- nvmf/common.sh@543 -- # cat 00:19:38.115 21:20:32 -- nvmf/common.sh@545 -- # jq . 00:19:38.115 21:20:32 -- nvmf/common.sh@546 -- # IFS=, 00:19:38.115 21:20:32 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:38.115 "params": { 00:19:38.115 "name": "Nvme1", 00:19:38.115 "trtype": "rdma", 00:19:38.115 "traddr": "192.168.100.8", 00:19:38.115 "adrfam": "ipv4", 00:19:38.115 "trsvcid": "4420", 00:19:38.115 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:38.115 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:38.115 "hdgst": false, 00:19:38.115 "ddgst": false 00:19:38.115 }, 00:19:38.115 "method": "bdev_nvme_attach_controller" 00:19:38.115 }' 00:19:38.115 [2024-04-23 21:20:32.319962] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:19:38.115 [2024-04-23 21:20:32.320011] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1373517 ] 00:19:38.115 EAL: No free 2048 kB hugepages reported on node 1 00:19:38.115 [2024-04-23 21:20:32.372716] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:38.373 [2024-04-23 21:20:32.441202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:38.373 [2024-04-23 21:20:32.441310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:38.373 [2024-04-23 21:20:32.441313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:38.373 I/O targets: 00:19:38.373 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:38.373 00:19:38.373 00:19:38.373 CUnit - A unit testing framework for C - Version 2.1-3 00:19:38.373 http://cunit.sourceforge.net/ 00:19:38.373 00:19:38.373 00:19:38.373 Suite: bdevio tests on: Nvme1n1 00:19:38.373 Test: blockdev write read block ...passed 00:19:38.373 Test: blockdev write zeroes read block ...passed 00:19:38.373 Test: blockdev write zeroes read no split ...passed 00:19:38.373 Test: blockdev write zeroes read split ...passed 00:19:38.373 Test: blockdev write zeroes read split partial ...passed 00:19:38.373 Test: blockdev reset ...[2024-04-23 21:20:32.644101] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:38.631 [2024-04-23 21:20:32.666864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:38.631 [2024-04-23 21:20:32.693511] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:38.631 passed 00:19:38.631 Test: blockdev write read 8 blocks ...passed 00:19:38.631 Test: blockdev write read size > 128k ...passed 00:19:38.631 Test: blockdev write read invalid size ...passed 00:19:38.631 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:38.631 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:38.631 Test: blockdev write read max offset ...passed 00:19:38.631 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:38.631 Test: blockdev writev readv 8 blocks ...passed 00:19:38.631 Test: blockdev writev readv 30 x 1block ...passed 00:19:38.631 Test: blockdev writev readv block ...passed 00:19:38.631 Test: blockdev writev readv size > 128k ...passed 00:19:38.631 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:38.631 Test: blockdev comparev and writev ...[2024-04-23 21:20:32.696224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.696827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:38.631 [2024-04-23 21:20:32.696834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:38.631 passed 00:19:38.631 Test: blockdev nvme passthru rw ...passed 00:19:38.631 Test: blockdev nvme passthru vendor specific ...[2024-04-23 21:20:32.697069] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:38.631 [2024-04-23 21:20:32.697078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.697121] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:38.631 [2024-04-23 21:20:32.697133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.697178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:38.631 [2024-04-23 21:20:32.697186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:38.631 [2024-04-23 21:20:32.697223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:38.631 [2024-04-23 21:20:32.697230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:38.631 passed 00:19:38.631 Test: blockdev nvme admin passthru ...passed 00:19:38.631 Test: blockdev copy ...passed 00:19:38.631 00:19:38.631 Run Summary: Type Total Ran Passed Failed Inactive 00:19:38.631 suites 1 1 n/a 0 0 00:19:38.631 tests 23 23 23 0 0 00:19:38.631 asserts 152 152 152 0 n/a 00:19:38.631 00:19:38.631 Elapsed time = 0.171 seconds 00:19:38.888 21:20:32 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:38.888 21:20:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:38.888 21:20:32 -- common/autotest_common.sh@10 -- # set +x 00:19:38.888 21:20:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:38.888 21:20:32 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:38.888 21:20:32 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:38.888 21:20:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:38.888 21:20:32 -- nvmf/common.sh@117 -- # sync 00:19:38.888 21:20:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:38.888 21:20:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:38.888 21:20:32 -- nvmf/common.sh@120 -- # set +e 00:19:38.888 21:20:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:38.888 21:20:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:38.888 rmmod nvme_rdma 00:19:38.888 rmmod nvme_fabrics 00:19:38.888 21:20:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:38.888 21:20:32 -- nvmf/common.sh@124 -- # set -e 00:19:38.888 21:20:32 -- nvmf/common.sh@125 -- # return 0 00:19:38.888 21:20:32 -- nvmf/common.sh@478 -- # '[' -n 1373405 ']' 00:19:38.888 21:20:32 -- nvmf/common.sh@479 -- # killprocess 1373405 00:19:38.888 21:20:32 -- common/autotest_common.sh@936 -- # '[' -z 1373405 ']' 00:19:38.888 21:20:32 -- common/autotest_common.sh@940 -- # kill -0 1373405 00:19:38.888 21:20:32 -- common/autotest_common.sh@941 -- # uname 00:19:38.888 21:20:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:38.888 21:20:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1373405 00:19:38.888 21:20:33 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:38.888 21:20:33 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:38.888 21:20:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1373405' 00:19:38.888 killing process with pid 1373405 00:19:38.888 21:20:33 -- common/autotest_common.sh@955 -- # kill 1373405 00:19:38.888 21:20:33 -- common/autotest_common.sh@960 -- # wait 1373405 00:19:38.888 [2024-04-23 21:20:33.081159] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:39.146 21:20:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:39.146 21:20:33 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:39.146 00:19:39.146 real 0m7.682s 00:19:39.146 user 0m10.153s 00:19:39.146 sys 0m4.656s 00:19:39.146 21:20:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:39.146 21:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:39.146 ************************************ 00:19:39.146 END TEST nvmf_bdevio 00:19:39.146 ************************************ 00:19:39.146 21:20:33 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:19:39.146 21:20:33 -- nvmf/nvmf.sh@64 -- # '[' 1 -eq 1 ']' 00:19:39.146 21:20:33 -- nvmf/nvmf.sh@65 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:39.146 21:20:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:39.146 21:20:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:39.146 21:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:39.405 ************************************ 00:19:39.405 START TEST nvmf_fuzz 00:19:39.405 ************************************ 00:19:39.405 21:20:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:39.405 * Looking for test storage... 00:19:39.405 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:39.405 21:20:33 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:39.405 21:20:33 -- nvmf/common.sh@7 -- # uname -s 00:19:39.405 21:20:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:39.405 21:20:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:39.405 21:20:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:39.405 21:20:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:39.405 21:20:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:39.405 21:20:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:39.405 21:20:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:39.405 21:20:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:39.405 21:20:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:39.405 21:20:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:39.405 21:20:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:39.405 21:20:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:39.405 21:20:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:39.405 21:20:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:39.405 21:20:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:39.405 21:20:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:39.405 21:20:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:39.405 21:20:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:39.405 21:20:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:39.405 21:20:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:39.405 21:20:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.405 21:20:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.405 21:20:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.405 21:20:33 -- paths/export.sh@5 -- # export PATH 00:19:39.405 21:20:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.405 21:20:33 -- nvmf/common.sh@47 -- # : 0 00:19:39.405 21:20:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:39.405 21:20:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:39.405 21:20:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:39.405 21:20:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:39.405 21:20:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:39.405 21:20:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:39.405 21:20:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:39.405 21:20:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:39.405 21:20:33 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:39.405 21:20:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:39.405 21:20:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:39.405 21:20:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:39.405 21:20:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:39.405 21:20:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:39.405 21:20:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:39.406 21:20:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:39.406 21:20:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.406 21:20:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:39.406 21:20:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:39.406 21:20:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:39.406 21:20:33 -- common/autotest_common.sh@10 -- # set +x 00:19:44.671 21:20:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:44.671 21:20:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:44.671 21:20:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:44.671 21:20:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:44.671 21:20:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:44.671 21:20:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:44.671 21:20:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:44.671 21:20:38 -- nvmf/common.sh@295 -- # net_devs=() 00:19:44.671 21:20:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:44.671 21:20:38 -- nvmf/common.sh@296 -- # e810=() 00:19:44.671 21:20:38 -- nvmf/common.sh@296 -- # local -ga e810 00:19:44.671 21:20:38 -- nvmf/common.sh@297 -- # x722=() 00:19:44.671 21:20:38 -- nvmf/common.sh@297 -- # local -ga x722 00:19:44.671 21:20:38 -- nvmf/common.sh@298 -- # mlx=() 00:19:44.671 21:20:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:44.671 21:20:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:44.671 21:20:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:44.672 21:20:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:44.672 21:20:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:44.672 21:20:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:44.672 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:44.672 21:20:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:44.672 21:20:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:44.672 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:44.672 21:20:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:44.672 21:20:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.672 21:20:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.672 21:20:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:44.672 Found net devices under 0000:18:00.0: mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.672 21:20:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.672 21:20:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:44.672 Found net devices under 0000:18:00.1: mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.672 21:20:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:44.672 21:20:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:44.672 21:20:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:44.672 21:20:38 -- nvmf/common.sh@58 -- # uname 00:19:44.672 21:20:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:44.672 21:20:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:44.672 21:20:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:44.672 21:20:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:44.672 21:20:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:44.672 21:20:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:44.672 21:20:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:44.672 21:20:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:44.672 21:20:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:44.672 21:20:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:44.672 21:20:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:44.672 21:20:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:44.672 21:20:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:44.672 21:20:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:44.672 21:20:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:44.672 21:20:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@105 -- # continue 2 00:19:44.672 21:20:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@105 -- # continue 2 00:19:44.672 21:20:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:44.672 21:20:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:44.672 21:20:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:44.672 21:20:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:44.672 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:44.672 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:44.672 altname enp24s0f0np0 00:19:44.672 altname ens785f0np0 00:19:44.672 inet 192.168.100.8/24 scope global mlx_0_0 00:19:44.672 valid_lft forever preferred_lft forever 00:19:44.672 21:20:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:44.672 21:20:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:44.672 21:20:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:44.672 21:20:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:44.672 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:44.672 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:44.672 altname enp24s0f1np1 00:19:44.672 altname ens785f1np1 00:19:44.672 inet 192.168.100.9/24 scope global mlx_0_1 00:19:44.672 valid_lft forever preferred_lft forever 00:19:44.672 21:20:38 -- nvmf/common.sh@411 -- # return 0 00:19:44.672 21:20:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:44.672 21:20:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:44.672 21:20:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:44.672 21:20:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:44.672 21:20:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:44.672 21:20:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:44.672 21:20:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:44.672 21:20:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:44.672 21:20:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:44.672 21:20:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@105 -- # continue 2 00:19:44.672 21:20:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:44.672 21:20:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:44.672 21:20:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@105 -- # continue 2 00:19:44.672 21:20:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:44.672 21:20:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:44.672 21:20:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:44.672 21:20:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:44.672 21:20:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:44.672 21:20:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:44.672 192.168.100.9' 00:19:44.672 21:20:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:44.672 192.168.100.9' 00:19:44.672 21:20:38 -- nvmf/common.sh@446 -- # head -n 1 00:19:44.672 21:20:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:44.672 21:20:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:44.672 192.168.100.9' 00:19:44.672 21:20:38 -- nvmf/common.sh@447 -- # tail -n +2 00:19:44.672 21:20:38 -- nvmf/common.sh@447 -- # head -n 1 00:19:44.672 21:20:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:44.672 21:20:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:44.672 21:20:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:44.672 21:20:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:44.672 21:20:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:44.672 21:20:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:44.672 21:20:38 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1376995 00:19:44.673 21:20:38 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:44.673 21:20:38 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1376995 00:19:44.673 21:20:38 -- common/autotest_common.sh@817 -- # '[' -z 1376995 ']' 00:19:44.673 21:20:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:44.673 21:20:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:44.673 21:20:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:44.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:44.673 21:20:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:44.673 21:20:38 -- target/fabrics_fuzz.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:19:44.673 21:20:38 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 21:20:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:45.606 21:20:39 -- common/autotest_common.sh@850 -- # return 0 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:45.606 21:20:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.606 21:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 21:20:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:19:45.606 21:20:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.606 21:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 Malloc0 00:19:45.606 21:20:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:45.606 21:20:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.606 21:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 21:20:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:45.606 21:20:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.606 21:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 21:20:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:45.606 21:20:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:45.606 21:20:39 -- common/autotest_common.sh@10 -- # set +x 00:19:45.606 21:20:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' 00:19:45.606 21:20:39 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -N -a 00:20:17.654 Fuzzing completed. Shutting down the fuzz application 00:20:17.654 00:20:17.654 Dumping successful admin opcodes: 00:20:17.654 8, 9, 10, 24, 00:20:17.654 Dumping successful io opcodes: 00:20:17.654 0, 9, 00:20:17.654 NS: 0x200003af1f00 I/O qp, Total commands completed: 1324374, total successful commands: 7797, random_seed: 1293450176 00:20:17.654 NS: 0x200003af1f00 admin qp, Total commands completed: 167822, total successful commands: 1364, random_seed: 3169043264 00:20:17.654 21:21:10 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -j /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:20:17.654 Fuzzing completed. Shutting down the fuzz application 00:20:17.654 00:20:17.654 Dumping successful admin opcodes: 00:20:17.654 24, 00:20:17.654 Dumping successful io opcodes: 00:20:17.654 00:20:17.654 NS: 0x200003af1f00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 4153108170 00:20:17.654 NS: 0x200003af1f00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 4153186042 00:20:17.654 21:21:11 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:17.654 21:21:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.654 21:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:17.654 21:21:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.654 21:21:11 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:20:17.654 21:21:11 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:20:17.654 21:21:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:17.654 21:21:11 -- nvmf/common.sh@117 -- # sync 00:20:17.654 21:21:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:17.654 21:21:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:17.654 21:21:11 -- nvmf/common.sh@120 -- # set +e 00:20:17.654 21:21:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:17.654 21:21:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:17.654 rmmod nvme_rdma 00:20:17.654 rmmod nvme_fabrics 00:20:17.654 21:21:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:17.654 21:21:11 -- nvmf/common.sh@124 -- # set -e 00:20:17.654 21:21:11 -- nvmf/common.sh@125 -- # return 0 00:20:17.654 21:21:11 -- nvmf/common.sh@478 -- # '[' -n 1376995 ']' 00:20:17.654 21:21:11 -- nvmf/common.sh@479 -- # killprocess 1376995 00:20:17.654 21:21:11 -- common/autotest_common.sh@936 -- # '[' -z 1376995 ']' 00:20:17.654 21:21:11 -- common/autotest_common.sh@940 -- # kill -0 1376995 00:20:17.654 21:21:11 -- common/autotest_common.sh@941 -- # uname 00:20:17.654 21:21:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.654 21:21:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1376995 00:20:17.654 21:21:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:17.654 21:21:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:17.654 21:21:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1376995' 00:20:17.654 killing process with pid 1376995 00:20:17.654 21:21:11 -- common/autotest_common.sh@955 -- # kill 1376995 00:20:17.654 21:21:11 -- common/autotest_common.sh@960 -- # wait 1376995 00:20:17.654 21:21:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:17.654 21:21:11 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:17.654 21:21:11 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:20:17.654 00:20:17.654 real 0m38.278s 00:20:17.654 user 0m51.388s 00:20:17.654 sys 0m17.604s 00:20:17.654 21:21:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:17.654 21:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:17.654 ************************************ 00:20:17.654 END TEST nvmf_fuzz 00:20:17.654 ************************************ 00:20:17.654 21:21:11 -- nvmf/nvmf.sh@66 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:17.654 21:21:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:17.654 21:21:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:17.654 21:21:11 -- common/autotest_common.sh@10 -- # set +x 00:20:17.654 ************************************ 00:20:17.654 START TEST nvmf_multiconnection 00:20:17.654 ************************************ 00:20:17.654 21:21:11 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:17.913 * Looking for test storage... 00:20:17.913 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:20:17.913 21:21:11 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:17.913 21:21:11 -- nvmf/common.sh@7 -- # uname -s 00:20:17.913 21:21:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:17.913 21:21:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:17.913 21:21:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:17.913 21:21:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:17.913 21:21:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:17.913 21:21:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:17.913 21:21:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:17.913 21:21:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:17.913 21:21:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:17.913 21:21:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:17.913 21:21:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:20:17.913 21:21:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:20:17.913 21:21:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:17.913 21:21:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:17.913 21:21:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:17.913 21:21:11 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:17.913 21:21:11 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:17.913 21:21:11 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:17.913 21:21:11 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:17.913 21:21:11 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:17.913 21:21:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:17.913 21:21:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:17.913 21:21:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:17.913 21:21:11 -- paths/export.sh@5 -- # export PATH 00:20:17.913 21:21:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:17.913 21:21:11 -- nvmf/common.sh@47 -- # : 0 00:20:17.914 21:21:11 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:17.914 21:21:11 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:17.914 21:21:11 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:17.914 21:21:11 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:17.914 21:21:11 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:17.914 21:21:11 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:17.914 21:21:11 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:17.914 21:21:11 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:17.914 21:21:11 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:17.914 21:21:12 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:17.914 21:21:12 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:20:17.914 21:21:12 -- target/multiconnection.sh@16 -- # nvmftestinit 00:20:17.914 21:21:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:17.914 21:21:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:17.914 21:21:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:17.914 21:21:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:17.914 21:21:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:17.914 21:21:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:17.914 21:21:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:17.914 21:21:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:17.914 21:21:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:17.914 21:21:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:17.914 21:21:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:17.914 21:21:12 -- common/autotest_common.sh@10 -- # set +x 00:20:23.173 21:21:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:23.174 21:21:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:23.174 21:21:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:23.174 21:21:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:23.174 21:21:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:23.174 21:21:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:23.174 21:21:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:23.174 21:21:17 -- nvmf/common.sh@295 -- # net_devs=() 00:20:23.174 21:21:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:23.174 21:21:17 -- nvmf/common.sh@296 -- # e810=() 00:20:23.174 21:21:17 -- nvmf/common.sh@296 -- # local -ga e810 00:20:23.174 21:21:17 -- nvmf/common.sh@297 -- # x722=() 00:20:23.174 21:21:17 -- nvmf/common.sh@297 -- # local -ga x722 00:20:23.174 21:21:17 -- nvmf/common.sh@298 -- # mlx=() 00:20:23.174 21:21:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:23.174 21:21:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:23.174 21:21:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:23.174 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:23.174 21:21:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:23.174 21:21:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:23.174 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:23.174 21:21:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:23.174 21:21:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.174 21:21:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.174 21:21:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:23.174 Found net devices under 0000:18:00.0: mlx_0_0 00:20:23.174 21:21:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.174 21:21:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.174 21:21:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:23.174 Found net devices under 0000:18:00.1: mlx_0_1 00:20:23.174 21:21:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.174 21:21:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:23.174 21:21:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:23.174 21:21:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:23.174 21:21:17 -- nvmf/common.sh@58 -- # uname 00:20:23.174 21:21:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:23.174 21:21:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:23.174 21:21:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:23.174 21:21:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:23.174 21:21:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:23.174 21:21:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:23.174 21:21:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:23.174 21:21:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:23.174 21:21:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:23.174 21:21:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:23.174 21:21:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:23.174 21:21:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:23.174 21:21:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:23.174 21:21:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:23.174 21:21:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:23.174 21:21:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:23.174 21:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:23.174 21:21:17 -- nvmf/common.sh@105 -- # continue 2 00:20:23.174 21:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.174 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:23.174 21:21:17 -- nvmf/common.sh@105 -- # continue 2 00:20:23.174 21:21:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:23.174 21:21:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:23.174 21:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:23.174 21:21:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:23.174 21:21:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:23.174 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:23.174 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:20:23.174 altname enp24s0f0np0 00:20:23.174 altname ens785f0np0 00:20:23.174 inet 192.168.100.8/24 scope global mlx_0_0 00:20:23.174 valid_lft forever preferred_lft forever 00:20:23.174 21:21:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:23.174 21:21:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:23.174 21:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:23.174 21:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:23.174 21:21:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:23.174 21:21:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:23.174 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:23.174 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:20:23.174 altname enp24s0f1np1 00:20:23.174 altname ens785f1np1 00:20:23.174 inet 192.168.100.9/24 scope global mlx_0_1 00:20:23.174 valid_lft forever preferred_lft forever 00:20:23.174 21:21:17 -- nvmf/common.sh@411 -- # return 0 00:20:23.174 21:21:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:23.174 21:21:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:23.174 21:21:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:23.174 21:21:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:23.174 21:21:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:23.174 21:21:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:23.175 21:21:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:23.175 21:21:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:23.175 21:21:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:23.175 21:21:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:23.175 21:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:23.175 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.175 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:23.175 21:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:23.175 21:21:17 -- nvmf/common.sh@105 -- # continue 2 00:20:23.175 21:21:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:23.175 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.175 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:23.175 21:21:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:23.175 21:21:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:23.175 21:21:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:23.175 21:21:17 -- nvmf/common.sh@105 -- # continue 2 00:20:23.175 21:21:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:23.175 21:21:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:23.175 21:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:23.175 21:21:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:23.175 21:21:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:23.175 21:21:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:23.175 21:21:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:23.175 21:21:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:23.175 192.168.100.9' 00:20:23.175 21:21:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:23.175 192.168.100.9' 00:20:23.175 21:21:17 -- nvmf/common.sh@446 -- # head -n 1 00:20:23.175 21:21:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:23.175 21:21:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:23.175 192.168.100.9' 00:20:23.175 21:21:17 -- nvmf/common.sh@447 -- # tail -n +2 00:20:23.175 21:21:17 -- nvmf/common.sh@447 -- # head -n 1 00:20:23.175 21:21:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:23.175 21:21:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:23.175 21:21:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:23.175 21:21:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:23.175 21:21:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:23.175 21:21:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:23.175 21:21:17 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:20:23.175 21:21:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:23.175 21:21:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:23.175 21:21:17 -- common/autotest_common.sh@10 -- # set +x 00:20:23.175 21:21:17 -- nvmf/common.sh@470 -- # nvmfpid=1386984 00:20:23.175 21:21:17 -- nvmf/common.sh@471 -- # waitforlisten 1386984 00:20:23.175 21:21:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:23.175 21:21:17 -- common/autotest_common.sh@817 -- # '[' -z 1386984 ']' 00:20:23.175 21:21:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:23.175 21:21:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:23.175 21:21:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:23.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:23.175 21:21:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:23.175 21:21:17 -- common/autotest_common.sh@10 -- # set +x 00:20:23.175 [2024-04-23 21:21:17.294956] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:20:23.175 [2024-04-23 21:21:17.295011] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:23.175 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.175 [2024-04-23 21:21:17.347420] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:23.175 [2024-04-23 21:21:17.422914] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:23.175 [2024-04-23 21:21:17.422949] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:23.175 [2024-04-23 21:21:17.422956] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:23.175 [2024-04-23 21:21:17.422962] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:23.175 [2024-04-23 21:21:17.422966] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:23.175 [2024-04-23 21:21:17.423009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:23.175 [2024-04-23 21:21:17.423024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.175 [2024-04-23 21:21:17.423111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:23.175 [2024-04-23 21:21:17.423113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:24.108 21:21:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:24.108 21:21:18 -- common/autotest_common.sh@850 -- # return 0 00:20:24.108 21:21:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:24.108 21:21:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:24.108 21:21:18 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 [2024-04-23 21:21:18.149325] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13286b0/0x132cba0) succeed. 00:20:24.108 [2024-04-23 21:21:18.158670] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1329cf0/0x136e230) succeed. 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@21 -- # seq 1 11 00:20:24.108 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.108 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 Malloc1 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 [2024-04-23 21:21:18.316553] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.108 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 Malloc2 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.108 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.108 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.108 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:20:24.108 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.108 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.366 Malloc3 00:20:24.366 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 Malloc4 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 Malloc5 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 Malloc6 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 Malloc7 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 Malloc8 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t rdma -a 192.168.100.8 -s 4420 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.367 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.367 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.367 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:20:24.367 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.367 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 Malloc9 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t rdma -a 192.168.100.8 -s 4420 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.625 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 Malloc10 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t rdma -a 192.168.100.8 -s 4420 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.625 21:21:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:20:24.625 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.625 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.625 Malloc11 00:20:24.625 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.625 21:21:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:20:24.626 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.626 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.626 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.626 21:21:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:20:24.626 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.626 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.626 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.626 21:21:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t rdma -a 192.168.100.8 -s 4420 00:20:24.626 21:21:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.626 21:21:18 -- common/autotest_common.sh@10 -- # set +x 00:20:24.626 21:21:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.626 21:21:18 -- target/multiconnection.sh@28 -- # seq 1 11 00:20:24.626 21:21:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.626 21:21:18 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:20:25.557 21:21:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:20:25.557 21:21:19 -- common/autotest_common.sh@1184 -- # local i=0 00:20:25.557 21:21:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:25.557 21:21:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:25.557 21:21:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:28.086 21:21:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:28.087 21:21:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:28.087 21:21:21 -- common/autotest_common.sh@1193 -- # grep -c SPDK1 00:20:28.087 21:21:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:28.087 21:21:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:28.087 21:21:21 -- common/autotest_common.sh@1194 -- # return 0 00:20:28.087 21:21:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:28.087 21:21:21 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:20:28.653 21:21:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:20:28.653 21:21:22 -- common/autotest_common.sh@1184 -- # local i=0 00:20:28.653 21:21:22 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:28.653 21:21:22 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:28.653 21:21:22 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:30.552 21:21:24 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:30.552 21:21:24 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:30.552 21:21:24 -- common/autotest_common.sh@1193 -- # grep -c SPDK2 00:20:30.552 21:21:24 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:30.552 21:21:24 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:30.552 21:21:24 -- common/autotest_common.sh@1194 -- # return 0 00:20:30.552 21:21:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.552 21:21:24 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:20:31.486 21:21:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:20:31.486 21:21:25 -- common/autotest_common.sh@1184 -- # local i=0 00:20:31.486 21:21:25 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:31.486 21:21:25 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:31.486 21:21:25 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:34.014 21:21:27 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:34.014 21:21:27 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:34.014 21:21:27 -- common/autotest_common.sh@1193 -- # grep -c SPDK3 00:20:34.014 21:21:27 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:34.014 21:21:27 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:34.014 21:21:27 -- common/autotest_common.sh@1194 -- # return 0 00:20:34.014 21:21:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:34.014 21:21:27 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:20:34.580 21:21:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:20:34.580 21:21:28 -- common/autotest_common.sh@1184 -- # local i=0 00:20:34.580 21:21:28 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:34.580 21:21:28 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:34.580 21:21:28 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:36.533 21:21:30 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:36.533 21:21:30 -- common/autotest_common.sh@1193 -- # grep -c SPDK4 00:20:36.533 21:21:30 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:36.533 21:21:30 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:36.533 21:21:30 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:36.533 21:21:30 -- common/autotest_common.sh@1194 -- # return 0 00:20:36.534 21:21:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.534 21:21:30 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:20:37.468 21:21:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:20:37.468 21:21:31 -- common/autotest_common.sh@1184 -- # local i=0 00:20:37.468 21:21:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:37.468 21:21:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:37.468 21:21:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:39.995 21:21:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:39.995 21:21:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:39.995 21:21:33 -- common/autotest_common.sh@1193 -- # grep -c SPDK5 00:20:39.995 21:21:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:39.995 21:21:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:39.995 21:21:33 -- common/autotest_common.sh@1194 -- # return 0 00:20:39.995 21:21:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:39.995 21:21:33 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode6 -a 192.168.100.8 -s 4420 00:20:40.562 21:21:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:20:40.562 21:21:34 -- common/autotest_common.sh@1184 -- # local i=0 00:20:40.562 21:21:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:40.562 21:21:34 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:40.562 21:21:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:42.462 21:21:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:42.462 21:21:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:42.462 21:21:36 -- common/autotest_common.sh@1193 -- # grep -c SPDK6 00:20:42.462 21:21:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:42.462 21:21:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:42.462 21:21:36 -- common/autotest_common.sh@1194 -- # return 0 00:20:42.462 21:21:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.462 21:21:36 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode7 -a 192.168.100.8 -s 4420 00:20:43.837 21:21:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:20:43.837 21:21:37 -- common/autotest_common.sh@1184 -- # local i=0 00:20:43.837 21:21:37 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:43.837 21:21:37 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:43.837 21:21:37 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:45.739 21:21:39 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:45.739 21:21:39 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:45.739 21:21:39 -- common/autotest_common.sh@1193 -- # grep -c SPDK7 00:20:45.739 21:21:39 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:45.739 21:21:39 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:45.739 21:21:39 -- common/autotest_common.sh@1194 -- # return 0 00:20:45.739 21:21:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:45.739 21:21:39 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode8 -a 192.168.100.8 -s 4420 00:20:46.672 21:21:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:20:46.672 21:21:40 -- common/autotest_common.sh@1184 -- # local i=0 00:20:46.672 21:21:40 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:46.672 21:21:40 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:46.672 21:21:40 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:48.570 21:21:42 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:48.570 21:21:42 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:48.570 21:21:42 -- common/autotest_common.sh@1193 -- # grep -c SPDK8 00:20:48.570 21:21:42 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:48.570 21:21:42 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:48.570 21:21:42 -- common/autotest_common.sh@1194 -- # return 0 00:20:48.570 21:21:42 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:48.570 21:21:42 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode9 -a 192.168.100.8 -s 4420 00:20:49.500 21:21:43 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:20:49.500 21:21:43 -- common/autotest_common.sh@1184 -- # local i=0 00:20:49.500 21:21:43 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:49.500 21:21:43 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:49.500 21:21:43 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:52.024 21:21:45 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:52.024 21:21:45 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:52.024 21:21:45 -- common/autotest_common.sh@1193 -- # grep -c SPDK9 00:20:52.024 21:21:45 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:52.024 21:21:45 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:52.024 21:21:45 -- common/autotest_common.sh@1194 -- # return 0 00:20:52.024 21:21:45 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:52.024 21:21:45 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode10 -a 192.168.100.8 -s 4420 00:20:52.589 21:21:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:52.589 21:21:46 -- common/autotest_common.sh@1184 -- # local i=0 00:20:52.589 21:21:46 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:52.589 21:21:46 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:52.589 21:21:46 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:54.486 21:21:48 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:54.486 21:21:48 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:54.486 21:21:48 -- common/autotest_common.sh@1193 -- # grep -c SPDK10 00:20:54.486 21:21:48 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:54.486 21:21:48 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:54.486 21:21:48 -- common/autotest_common.sh@1194 -- # return 0 00:20:54.486 21:21:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:54.486 21:21:48 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode11 -a 192.168.100.8 -s 4420 00:20:55.418 21:21:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:55.418 21:21:49 -- common/autotest_common.sh@1184 -- # local i=0 00:20:55.418 21:21:49 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:55.418 21:21:49 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:55.418 21:21:49 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:57.943 21:21:51 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:57.943 21:21:51 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:57.943 21:21:51 -- common/autotest_common.sh@1193 -- # grep -c SPDK11 00:20:57.943 21:21:51 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:57.943 21:21:51 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:57.943 21:21:51 -- common/autotest_common.sh@1194 -- # return 0 00:20:57.943 21:21:51 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:57.943 [global] 00:20:57.943 thread=1 00:20:57.943 invalidate=1 00:20:57.943 rw=read 00:20:57.943 time_based=1 00:20:57.943 runtime=10 00:20:57.943 ioengine=libaio 00:20:57.943 direct=1 00:20:57.943 bs=262144 00:20:57.943 iodepth=64 00:20:57.943 norandommap=1 00:20:57.943 numjobs=1 00:20:57.943 00:20:57.943 [job0] 00:20:57.943 filename=/dev/nvme0n1 00:20:57.943 [job1] 00:20:57.943 filename=/dev/nvme10n1 00:20:57.943 [job2] 00:20:57.943 filename=/dev/nvme1n1 00:20:57.943 [job3] 00:20:57.943 filename=/dev/nvme2n1 00:20:57.943 [job4] 00:20:57.943 filename=/dev/nvme3n1 00:20:57.943 [job5] 00:20:57.943 filename=/dev/nvme4n1 00:20:57.943 [job6] 00:20:57.943 filename=/dev/nvme5n1 00:20:57.943 [job7] 00:20:57.943 filename=/dev/nvme6n1 00:20:57.943 [job8] 00:20:57.943 filename=/dev/nvme7n1 00:20:57.943 [job9] 00:20:57.943 filename=/dev/nvme8n1 00:20:57.943 [job10] 00:20:57.943 filename=/dev/nvme9n1 00:20:57.943 Could not set queue depth (nvme0n1) 00:20:57.943 Could not set queue depth (nvme10n1) 00:20:57.943 Could not set queue depth (nvme1n1) 00:20:57.943 Could not set queue depth (nvme2n1) 00:20:57.943 Could not set queue depth (nvme3n1) 00:20:57.943 Could not set queue depth (nvme4n1) 00:20:57.943 Could not set queue depth (nvme5n1) 00:20:57.943 Could not set queue depth (nvme6n1) 00:20:57.943 Could not set queue depth (nvme7n1) 00:20:57.943 Could not set queue depth (nvme8n1) 00:20:57.943 Could not set queue depth (nvme9n1) 00:20:57.943 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:57.943 fio-3.35 00:20:57.943 Starting 11 threads 00:21:10.137 00:21:10.137 job0: (groupid=0, jobs=1): err= 0: pid=1393870: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=1524, BW=381MiB/s (400MB/s)(3833MiB/10055msec) 00:21:10.137 slat (usec): min=7, max=49634, avg=572.62, stdev=2123.45 00:21:10.137 clat (msec): min=10, max=137, avg=41.36, stdev=21.22 00:21:10.137 lat (msec): min=10, max=140, avg=41.94, stdev=21.58 00:21:10.137 clat percentiles (msec): 00:21:10.137 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 24], 00:21:10.137 | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 44], 00:21:10.137 | 70.00th=[ 53], 80.00th=[ 62], 90.00th=[ 74], 95.00th=[ 82], 00:21:10.137 | 99.00th=[ 94], 99.50th=[ 99], 99.90th=[ 108], 99.95th=[ 122], 00:21:10.137 | 99.99th=[ 138] 00:21:10.137 bw ( KiB/s): min=191488, max=823296, per=9.13%, avg=390811.40, stdev=172511.11, samples=20 00:21:10.137 iops : min= 748, max= 3216, avg=1526.50, stdev=673.86, samples=20 00:21:10.137 lat (msec) : 20=16.07%, 50=53.16%, 100=30.43%, 250=0.33% 00:21:10.137 cpu : usr=0.37%, sys=3.68%, ctx=4498, majf=0, minf=4097 00:21:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.137 issued rwts: total=15332,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.137 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.137 job1: (groupid=0, jobs=1): err= 0: pid=1393871: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=1133, BW=283MiB/s (297MB/s)(2847MiB/10049msec) 00:21:10.137 slat (usec): min=8, max=26796, avg=860.11, stdev=2273.03 00:21:10.137 clat (msec): min=9, max=119, avg=55.57, stdev=18.54 00:21:10.137 lat (msec): min=9, max=121, avg=56.43, stdev=18.91 00:21:10.137 clat percentiles (msec): 00:21:10.137 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 32], 20.00th=[ 37], 00:21:10.137 | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 61], 00:21:10.137 | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 82], 95.00th=[ 89], 00:21:10.137 | 99.00th=[ 99], 99.50th=[ 104], 99.90th=[ 107], 99.95th=[ 111], 00:21:10.137 | 99.99th=[ 116] 00:21:10.137 bw ( KiB/s): min=191488, max=498176, per=6.77%, avg=289797.55, stdev=87504.36, samples=20 00:21:10.137 iops : min= 748, max= 1946, avg=1131.90, stdev=341.76, samples=20 00:21:10.137 lat (msec) : 10=0.02%, 20=0.30%, 50=42.36%, 100=56.64%, 250=0.68% 00:21:10.137 cpu : usr=0.19%, sys=2.93%, ctx=2534, majf=0, minf=4097 00:21:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:21:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.137 issued rwts: total=11387,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.137 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.137 job2: (groupid=0, jobs=1): err= 0: pid=1393872: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=1873, BW=468MiB/s (491MB/s)(4690MiB/10013msec) 00:21:10.137 slat (usec): min=7, max=20170, avg=497.33, stdev=1321.01 00:21:10.137 clat (usec): min=678, max=70363, avg=33637.44, stdev=10183.79 00:21:10.137 lat (usec): min=710, max=78122, avg=34134.77, stdev=10378.87 00:21:10.137 clat percentiles (usec): 00:21:10.137 | 1.00th=[12256], 5.00th=[14353], 10.00th=[20579], 20.00th=[28181], 00:21:10.137 | 30.00th=[29230], 40.00th=[30016], 50.00th=[31065], 60.00th=[33817], 00:21:10.137 | 70.00th=[40109], 80.00th=[43779], 90.00th=[45876], 95.00th=[48497], 00:21:10.137 | 99.00th=[59507], 99.50th=[61604], 99.90th=[66847], 99.95th=[67634], 00:21:10.137 | 99.99th=[70779] 00:21:10.137 bw ( KiB/s): min=322560, max=758784, per=11.00%, avg=471063.11, stdev=100848.95, samples=19 00:21:10.137 iops : min= 1260, max= 2964, avg=1840.00, stdev=393.89, samples=19 00:21:10.137 lat (usec) : 750=0.01%, 1000=0.03% 00:21:10.137 lat (msec) : 2=0.19%, 4=0.07%, 10=0.41%, 20=9.10%, 50=86.28% 00:21:10.137 lat (msec) : 100=3.92% 00:21:10.137 cpu : usr=0.28%, sys=4.15%, ctx=4919, majf=0, minf=3221 00:21:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.137 issued rwts: total=18758,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.137 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.137 job3: (groupid=0, jobs=1): err= 0: pid=1393873: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=1977, BW=494MiB/s (518MB/s)(4952MiB/10015msec) 00:21:10.137 slat (usec): min=7, max=31034, avg=455.18, stdev=1378.71 00:21:10.137 clat (msec): min=10, max=106, avg=31.88, stdev=15.78 00:21:10.137 lat (msec): min=10, max=110, avg=32.33, stdev=16.03 00:21:10.137 clat percentiles (msec): 00:21:10.137 | 1.00th=[ 14], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 16], 00:21:10.137 | 30.00th=[ 20], 40.00th=[ 29], 50.00th=[ 31], 60.00th=[ 32], 00:21:10.137 | 70.00th=[ 41], 80.00th=[ 45], 90.00th=[ 49], 95.00th=[ 59], 00:21:10.137 | 99.00th=[ 88], 99.50th=[ 90], 99.90th=[ 97], 99.95th=[ 100], 00:21:10.137 | 99.99th=[ 107] 00:21:10.137 bw ( KiB/s): min=195584, max=895744, per=11.80%, avg=505252.45, stdev=216890.76, samples=20 00:21:10.137 iops : min= 764, max= 3499, avg=1973.55, stdev=847.17, samples=20 00:21:10.137 lat (msec) : 20=30.48%, 50=60.64%, 100=8.84%, 250=0.04% 00:21:10.137 cpu : usr=0.29%, sys=3.96%, ctx=5321, majf=0, minf=4097 00:21:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.137 issued rwts: total=19808,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.137 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.137 job4: (groupid=0, jobs=1): err= 0: pid=1393874: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=974, BW=244MiB/s (256MB/s)(2449MiB/10048msec) 00:21:10.137 slat (usec): min=8, max=43566, avg=953.40, stdev=2996.97 00:21:10.137 clat (msec): min=10, max=123, avg=64.64, stdev=14.69 00:21:10.137 lat (msec): min=10, max=135, avg=65.60, stdev=15.13 00:21:10.137 clat percentiles (msec): 00:21:10.137 | 1.00th=[ 34], 5.00th=[ 44], 10.00th=[ 46], 20.00th=[ 52], 00:21:10.137 | 30.00th=[ 59], 40.00th=[ 61], 50.00th=[ 63], 60.00th=[ 68], 00:21:10.137 | 70.00th=[ 73], 80.00th=[ 78], 90.00th=[ 85], 95.00th=[ 90], 00:21:10.137 | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 118], 99.95th=[ 124], 00:21:10.137 | 99.99th=[ 124] 00:21:10.137 bw ( KiB/s): min=186880, max=314880, per=5.82%, avg=249053.70, stdev=36968.96, samples=20 00:21:10.137 iops : min= 730, max= 1230, avg=972.75, stdev=144.30, samples=20 00:21:10.137 lat (msec) : 20=0.34%, 50=18.11%, 100=80.51%, 250=1.04% 00:21:10.137 cpu : usr=0.14%, sys=2.37%, ctx=2682, majf=0, minf=4097 00:21:10.137 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:10.137 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.137 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.137 issued rwts: total=9795,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.137 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.137 job5: (groupid=0, jobs=1): err= 0: pid=1393875: Tue Apr 23 21:22:02 2024 00:21:10.137 read: IOPS=1173, BW=293MiB/s (308MB/s)(2947MiB/10048msec) 00:21:10.137 slat (usec): min=8, max=59581, avg=657.28, stdev=2584.16 00:21:10.137 clat (msec): min=8, max=136, avg=53.85, stdev=19.84 00:21:10.137 lat (msec): min=9, max=147, avg=54.51, stdev=20.27 00:21:10.137 clat percentiles (msec): 00:21:10.137 | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], 00:21:10.137 | 30.00th=[ 43], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 59], 00:21:10.137 | 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 83], 95.00th=[ 89], 00:21:10.137 | 99.00th=[ 96], 99.50th=[ 101], 99.90th=[ 118], 99.95th=[ 127], 00:21:10.137 | 99.99th=[ 132] 00:21:10.137 bw ( KiB/s): min=208384, max=451462, per=7.01%, avg=300098.15, stdev=59601.00, samples=20 00:21:10.137 iops : min= 814, max= 1763, avg=1172.15, stdev=232.78, samples=20 00:21:10.137 lat (msec) : 10=0.09%, 20=2.49%, 50=44.71%, 100=52.18%, 250=0.52% 00:21:10.137 cpu : usr=0.28%, sys=3.48%, ctx=4607, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=11787,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 job6: (groupid=0, jobs=1): err= 0: pid=1393876: Tue Apr 23 21:22:02 2024 00:21:10.138 read: IOPS=1946, BW=487MiB/s (510MB/s)(4893MiB/10054msec) 00:21:10.138 slat (usec): min=7, max=45343, avg=456.12, stdev=1461.87 00:21:10.138 clat (msec): min=2, max=130, avg=32.39, stdev=17.62 00:21:10.138 lat (msec): min=2, max=130, avg=32.85, stdev=17.89 00:21:10.138 clat percentiles (msec): 00:21:10.138 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 17], 00:21:10.138 | 30.00th=[ 20], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 32], 00:21:10.138 | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 70], 00:21:10.138 | 99.00th=[ 89], 99.50th=[ 92], 99.90th=[ 115], 99.95th=[ 123], 00:21:10.138 | 99.99th=[ 131] 00:21:10.138 bw ( KiB/s): min=267752, max=871936, per=11.66%, avg=499287.35, stdev=194535.74, samples=20 00:21:10.138 iops : min= 1045, max= 3406, avg=1950.20, stdev=759.99, samples=20 00:21:10.138 lat (msec) : 4=0.65%, 10=0.87%, 20=29.41%, 50=55.09%, 100=13.77% 00:21:10.138 lat (msec) : 250=0.22% 00:21:10.138 cpu : usr=0.35%, sys=3.73%, ctx=5602, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=19571,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 job7: (groupid=0, jobs=1): err= 0: pid=1393877: Tue Apr 23 21:22:02 2024 00:21:10.138 read: IOPS=1794, BW=449MiB/s (470MB/s)(4511MiB/10055msec) 00:21:10.138 slat (usec): min=7, max=39002, avg=524.97, stdev=1431.46 00:21:10.138 clat (msec): min=10, max=127, avg=35.10, stdev=14.69 00:21:10.138 lat (msec): min=10, max=138, avg=35.63, stdev=14.90 00:21:10.138 clat percentiles (msec): 00:21:10.138 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 25], 00:21:10.138 | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 39], 00:21:10.138 | 70.00th=[ 44], 80.00th=[ 45], 90.00th=[ 51], 95.00th=[ 59], 00:21:10.138 | 99.00th=[ 90], 99.50th=[ 96], 99.90th=[ 104], 99.95th=[ 106], 00:21:10.138 | 99.99th=[ 128] 00:21:10.138 bw ( KiB/s): min=250880, max=809472, per=10.75%, avg=460292.60, stdev=146463.75, samples=20 00:21:10.138 iops : min= 980, max= 3162, avg=1797.90, stdev=572.18, samples=20 00:21:10.138 lat (msec) : 20=17.43%, 50=72.64%, 100=9.73%, 250=0.21% 00:21:10.138 cpu : usr=0.31%, sys=3.85%, ctx=4239, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=18045,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 job8: (groupid=0, jobs=1): err= 0: pid=1393878: Tue Apr 23 21:22:02 2024 00:21:10.138 read: IOPS=1726, BW=432MiB/s (453MB/s)(4339MiB/10053msec) 00:21:10.138 slat (usec): min=7, max=47919, avg=523.71, stdev=1763.20 00:21:10.138 clat (msec): min=10, max=127, avg=36.52, stdev=20.55 00:21:10.138 lat (msec): min=10, max=129, avg=37.04, stdev=20.88 00:21:10.138 clat percentiles (msec): 00:21:10.138 | 1.00th=[ 13], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 14], 00:21:10.138 | 30.00th=[ 17], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], 00:21:10.138 | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 64], 95.00th=[ 74], 00:21:10.138 | 99.00th=[ 88], 99.50th=[ 92], 99.90th=[ 112], 99.95th=[ 123], 00:21:10.138 | 99.99th=[ 124] 00:21:10.138 bw ( KiB/s): min=197120, max=1105408, per=10.34%, avg=442644.45, stdev=261031.12, samples=20 00:21:10.138 iops : min= 770, max= 4318, avg=1729.00, stdev=1019.70, samples=20 00:21:10.138 lat (msec) : 20=32.24%, 50=42.30%, 100=25.24%, 250=0.21% 00:21:10.138 cpu : usr=0.29%, sys=3.69%, ctx=4398, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=17355,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 job9: (groupid=0, jobs=1): err= 0: pid=1393879: Tue Apr 23 21:22:02 2024 00:21:10.138 read: IOPS=1654, BW=414MiB/s (434MB/s)(4158MiB/10055msec) 00:21:10.138 slat (usec): min=7, max=63810, avg=542.42, stdev=1875.66 00:21:10.138 clat (msec): min=6, max=161, avg=38.12, stdev=20.35 00:21:10.138 lat (msec): min=6, max=161, avg=38.66, stdev=20.67 00:21:10.138 clat percentiles (msec): 00:21:10.138 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 15], 20.00th=[ 19], 00:21:10.138 | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 37], 00:21:10.138 | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 69], 95.00th=[ 81], 00:21:10.138 | 99.00th=[ 93], 99.50th=[ 99], 99.90th=[ 120], 99.95th=[ 121], 00:21:10.138 | 99.99th=[ 161] 00:21:10.138 bw ( KiB/s): min=209920, max=1040896, per=9.91%, avg=424123.65, stdev=195916.19, samples=20 00:21:10.138 iops : min= 820, max= 4066, avg=1656.70, stdev=765.30, samples=20 00:21:10.138 lat (msec) : 10=0.11%, 20=20.82%, 50=54.82%, 100=23.91%, 250=0.35% 00:21:10.138 cpu : usr=0.33%, sys=3.66%, ctx=4668, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=16632,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 job10: (groupid=0, jobs=1): err= 0: pid=1393880: Tue Apr 23 21:22:02 2024 00:21:10.138 read: IOPS=962, BW=241MiB/s (252MB/s)(2417MiB/10046msec) 00:21:10.138 slat (usec): min=8, max=39719, avg=951.30, stdev=2885.95 00:21:10.138 clat (msec): min=9, max=131, avg=65.50, stdev=15.01 00:21:10.138 lat (msec): min=9, max=131, avg=66.45, stdev=15.47 00:21:10.138 clat percentiles (msec): 00:21:10.138 | 1.00th=[ 21], 5.00th=[ 44], 10.00th=[ 48], 20.00th=[ 57], 00:21:10.138 | 30.00th=[ 59], 40.00th=[ 61], 50.00th=[ 64], 60.00th=[ 69], 00:21:10.138 | 70.00th=[ 74], 80.00th=[ 78], 90.00th=[ 86], 95.00th=[ 90], 00:21:10.138 | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 114], 99.95th=[ 120], 00:21:10.138 | 99.99th=[ 132] 00:21:10.138 bw ( KiB/s): min=192512, max=318589, per=5.74%, avg=245891.40, stdev=36776.15, samples=20 00:21:10.138 iops : min= 752, max= 1244, avg=960.40, stdev=143.53, samples=20 00:21:10.138 lat (msec) : 10=0.05%, 20=0.85%, 50=11.65%, 100=86.39%, 250=1.07% 00:21:10.138 cpu : usr=0.26%, sys=2.89%, ctx=2652, majf=0, minf=4097 00:21:10.138 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:21:10.138 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:10.138 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:10.138 issued rwts: total=9668,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:10.138 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:10.138 00:21:10.138 Run status group 0 (all jobs): 00:21:10.138 READ: bw=4180MiB/s (4384MB/s), 241MiB/s-494MiB/s (252MB/s-518MB/s), io=41.0GiB (44.1GB), run=10013-10055msec 00:21:10.138 00:21:10.138 Disk stats (read/write): 00:21:10.138 nvme0n1: ios=30544/0, merge=0/0, ticks=1237987/0, in_queue=1237987, util=97.90% 00:21:10.138 nvme10n1: ios=22687/0, merge=0/0, ticks=1234836/0, in_queue=1234836, util=98.12% 00:21:10.138 nvme1n1: ios=35950/0, merge=0/0, ticks=1202646/0, in_queue=1202646, util=98.24% 00:21:10.138 nvme2n1: ios=39585/0, merge=0/0, ticks=1236123/0, in_queue=1236123, util=98.38% 00:21:10.138 nvme3n1: ios=19472/0, merge=0/0, ticks=1235094/0, in_queue=1235094, util=98.42% 00:21:10.138 nvme4n1: ios=23459/0, merge=0/0, ticks=1241879/0, in_queue=1241879, util=98.61% 00:21:10.138 nvme5n1: ios=39045/0, merge=0/0, ticks=1231539/0, in_queue=1231539, util=98.72% 00:21:10.138 nvme6n1: ios=35978/0, merge=0/0, ticks=1231570/0, in_queue=1231570, util=98.77% 00:21:10.138 nvme7n1: ios=34607/0, merge=0/0, ticks=1233537/0, in_queue=1233537, util=98.99% 00:21:10.138 nvme8n1: ios=33173/0, merge=0/0, ticks=1236798/0, in_queue=1236798, util=99.11% 00:21:10.138 nvme9n1: ios=19243/0, merge=0/0, ticks=1237357/0, in_queue=1237357, util=99.19% 00:21:10.138 21:22:02 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:21:10.138 [global] 00:21:10.138 thread=1 00:21:10.138 invalidate=1 00:21:10.138 rw=randwrite 00:21:10.138 time_based=1 00:21:10.138 runtime=10 00:21:10.138 ioengine=libaio 00:21:10.138 direct=1 00:21:10.138 bs=262144 00:21:10.138 iodepth=64 00:21:10.138 norandommap=1 00:21:10.138 numjobs=1 00:21:10.138 00:21:10.138 [job0] 00:21:10.138 filename=/dev/nvme0n1 00:21:10.138 [job1] 00:21:10.138 filename=/dev/nvme10n1 00:21:10.138 [job2] 00:21:10.138 filename=/dev/nvme1n1 00:21:10.138 [job3] 00:21:10.138 filename=/dev/nvme2n1 00:21:10.138 [job4] 00:21:10.138 filename=/dev/nvme3n1 00:21:10.138 [job5] 00:21:10.138 filename=/dev/nvme4n1 00:21:10.138 [job6] 00:21:10.138 filename=/dev/nvme5n1 00:21:10.138 [job7] 00:21:10.138 filename=/dev/nvme6n1 00:21:10.138 [job8] 00:21:10.138 filename=/dev/nvme7n1 00:21:10.138 [job9] 00:21:10.138 filename=/dev/nvme8n1 00:21:10.138 [job10] 00:21:10.138 filename=/dev/nvme9n1 00:21:10.138 Could not set queue depth (nvme0n1) 00:21:10.138 Could not set queue depth (nvme10n1) 00:21:10.138 Could not set queue depth (nvme1n1) 00:21:10.138 Could not set queue depth (nvme2n1) 00:21:10.138 Could not set queue depth (nvme3n1) 00:21:10.138 Could not set queue depth (nvme4n1) 00:21:10.138 Could not set queue depth (nvme5n1) 00:21:10.138 Could not set queue depth (nvme6n1) 00:21:10.138 Could not set queue depth (nvme7n1) 00:21:10.138 Could not set queue depth (nvme8n1) 00:21:10.138 Could not set queue depth (nvme9n1) 00:21:10.138 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.138 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:10.139 fio-3.35 00:21:10.139 Starting 11 threads 00:21:20.103 00:21:20.103 job0: (groupid=0, jobs=1): err= 0: pid=1395655: Tue Apr 23 21:22:13 2024 00:21:20.103 write: IOPS=1050, BW=263MiB/s (275MB/s)(2631MiB/10013msec); 0 zone resets 00:21:20.103 slat (usec): min=12, max=83040, avg=751.17, stdev=2599.28 00:21:20.103 clat (usec): min=221, max=215375, avg=60134.94, stdev=41616.66 00:21:20.103 lat (usec): min=260, max=215422, avg=60886.10, stdev=42145.64 00:21:20.103 clat percentiles (usec): 00:21:20.103 | 1.00th=[ 1139], 5.00th=[ 2933], 10.00th=[ 8586], 20.00th=[ 16909], 00:21:20.103 | 30.00th=[ 22152], 40.00th=[ 33424], 50.00th=[ 68682], 60.00th=[ 82314], 00:21:20.104 | 70.00th=[ 92799], 80.00th=[101188], 90.00th=[110625], 95.00th=[121111], 00:21:20.104 | 99.00th=[145753], 99.50th=[152044], 99.90th=[168821], 99.95th=[179307], 00:21:20.104 | 99.99th=[214959] 00:21:20.104 bw ( KiB/s): min=141824, max=602112, per=7.43%, avg=267753.40, stdev=111719.03, samples=20 00:21:20.104 iops : min= 554, max= 2352, avg=1045.90, stdev=436.41, samples=20 00:21:20.104 lat (usec) : 250=0.02%, 500=0.08%, 750=0.17%, 1000=0.48% 00:21:20.104 lat (msec) : 2=2.12%, 4=3.52%, 10=4.94%, 20=16.57%, 50=19.10% 00:21:20.104 lat (msec) : 100=31.71%, 250=21.30% 00:21:20.104 cpu : usr=2.24%, sys=3.14%, ctx=3936, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,10523,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job1: (groupid=0, jobs=1): err= 0: pid=1395675: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=1670, BW=418MiB/s (438MB/s)(4198MiB/10055msec); 0 zone resets 00:21:20.104 slat (usec): min=12, max=86276, avg=481.41, stdev=1781.87 00:21:20.104 clat (usec): min=202, max=177300, avg=37831.70, stdev=28601.16 00:21:20.104 lat (usec): min=246, max=187749, avg=38313.11, stdev=28983.79 00:21:20.104 clat percentiles (usec): 00:21:20.104 | 1.00th=[ 1237], 5.00th=[ 4555], 10.00th=[ 10290], 20.00th=[ 15795], 00:21:20.104 | 30.00th=[ 17171], 40.00th=[ 24773], 50.00th=[ 32637], 60.00th=[ 35914], 00:21:20.104 | 70.00th=[ 43779], 80.00th=[ 53740], 90.00th=[ 85459], 95.00th=[101188], 00:21:20.104 | 99.00th=[119014], 99.50th=[127402], 99.90th=[160433], 99.95th=[170918], 00:21:20.104 | 99.99th=[177210] 00:21:20.104 bw ( KiB/s): min=150016, max=935424, per=11.88%, avg=428194.40, stdev=219005.43, samples=20 00:21:20.104 iops : min= 586, max= 3654, avg=1672.60, stdev=855.45, samples=20 00:21:20.104 lat (usec) : 250=0.01%, 500=0.17%, 750=0.22%, 1000=0.38% 00:21:20.104 lat (msec) : 2=1.35%, 4=2.45%, 10=5.11%, 20=25.45%, 50=42.85% 00:21:20.104 lat (msec) : 100=16.44%, 250=5.56% 00:21:20.104 cpu : usr=3.03%, sys=4.45%, ctx=5372, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,16792,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job2: (groupid=0, jobs=1): err= 0: pid=1395684: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=1405, BW=351MiB/s (369MB/s)(3533MiB/10052msec); 0 zone resets 00:21:20.104 slat (usec): min=11, max=44747, avg=553.64, stdev=1732.41 00:21:20.104 clat (usec): min=455, max=140828, avg=44954.40, stdev=29957.00 00:21:20.104 lat (usec): min=487, max=146105, avg=45508.03, stdev=30383.03 00:21:20.104 clat percentiles (usec): 00:21:20.104 | 1.00th=[ 1139], 5.00th=[ 4228], 10.00th=[ 8979], 20.00th=[ 17695], 00:21:20.104 | 30.00th=[ 27132], 40.00th=[ 33817], 50.00th=[ 43254], 60.00th=[ 47973], 00:21:20.104 | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 95945], 95.00th=[108528], 00:21:20.104 | 99.00th=[124257], 99.50th=[127402], 99.90th=[137364], 99.95th=[137364], 00:21:20.104 | 99.99th=[141558] 00:21:20.104 bw ( KiB/s): min=145117, max=686592, per=9.99%, avg=360151.85, stdev=150952.42, samples=20 00:21:20.104 iops : min= 566, max= 2682, avg=1406.80, stdev=589.72, samples=20 00:21:20.104 lat (usec) : 500=0.01%, 750=0.13%, 1000=0.59% 00:21:20.104 lat (msec) : 2=1.83%, 4=2.22%, 10=6.35%, 20=11.41%, 50=41.86% 00:21:20.104 lat (msec) : 100=26.69%, 250=8.90% 00:21:20.104 cpu : usr=2.76%, sys=3.99%, ctx=5026, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,14132,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job3: (groupid=0, jobs=1): err= 0: pid=1395689: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=1562, BW=391MiB/s (410MB/s)(3927MiB/10054msec); 0 zone resets 00:21:20.104 slat (usec): min=14, max=78461, avg=523.79, stdev=1604.25 00:21:20.104 clat (usec): min=607, max=176166, avg=40424.01, stdev=23453.59 00:21:20.104 lat (usec): min=671, max=199565, avg=40947.79, stdev=23767.00 00:21:20.104 clat percentiles (msec): 00:21:20.104 | 1.00th=[ 3], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 23], 00:21:20.104 | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 39], 00:21:20.104 | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 75], 95.00th=[ 90], 00:21:20.104 | 99.00th=[ 111], 99.50th=[ 125], 99.90th=[ 153], 99.95th=[ 163], 00:21:20.104 | 99.99th=[ 176] 00:21:20.104 bw ( KiB/s): min=165888, max=743936, per=11.11%, avg=400477.85, stdev=142945.19, samples=20 00:21:20.104 iops : min= 648, max= 2906, avg=1564.35, stdev=558.39, samples=20 00:21:20.104 lat (usec) : 750=0.01%, 1000=0.10% 00:21:20.104 lat (msec) : 2=0.44%, 4=0.85%, 10=1.99%, 20=13.49%, 50=58.17% 00:21:20.104 lat (msec) : 100=22.54%, 250=2.40% 00:21:20.104 cpu : usr=2.92%, sys=4.40%, ctx=4529, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,15708,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job4: (groupid=0, jobs=1): err= 0: pid=1395691: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=901, BW=225MiB/s (236MB/s)(2265MiB/10052msec); 0 zone resets 00:21:20.104 slat (usec): min=16, max=70919, avg=961.63, stdev=2510.57 00:21:20.104 clat (msec): min=2, max=180, avg=70.02, stdev=32.96 00:21:20.104 lat (msec): min=2, max=180, avg=70.98, stdev=33.48 00:21:20.104 clat percentiles (msec): 00:21:20.104 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 28], 20.00th=[ 42], 00:21:20.104 | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 85], 00:21:20.104 | 70.00th=[ 97], 80.00th=[ 103], 90.00th=[ 112], 95.00th=[ 120], 00:21:20.104 | 99.00th=[ 133], 99.50th=[ 140], 99.90th=[ 167], 99.95th=[ 176], 00:21:20.104 | 99.99th=[ 182] 00:21:20.104 bw ( KiB/s): min=137216, max=568320, per=6.39%, avg=230334.05, stdev=105183.34, samples=20 00:21:20.104 iops : min= 536, max= 2220, avg=899.70, stdev=410.91, samples=20 00:21:20.104 lat (msec) : 4=0.33%, 10=2.76%, 20=5.08%, 50=24.17%, 100=43.32% 00:21:20.104 lat (msec) : 250=24.35% 00:21:20.104 cpu : usr=2.08%, sys=2.50%, ctx=2762, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,9061,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job5: (groupid=0, jobs=1): err= 0: pid=1395700: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=1737, BW=434MiB/s (455MB/s)(4366MiB/10050msec); 0 zone resets 00:21:20.104 slat (usec): min=11, max=70587, avg=495.57, stdev=1618.35 00:21:20.104 clat (usec): min=667, max=178995, avg=36327.40, stdev=22450.27 00:21:20.104 lat (usec): min=727, max=179064, avg=36822.98, stdev=22744.51 00:21:20.104 clat percentiles (msec): 00:21:20.104 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 17], 00:21:20.104 | 30.00th=[ 21], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 36], 00:21:20.104 | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 75], 00:21:20.104 | 99.00th=[ 116], 99.50th=[ 142], 99.90th=[ 167], 99.95th=[ 171], 00:21:20.104 | 99.99th=[ 178] 00:21:20.104 bw ( KiB/s): min=230912, max=967680, per=12.36%, avg=445321.00, stdev=207789.55, samples=20 00:21:20.104 iops : min= 902, max= 3780, avg=1739.50, stdev=811.59, samples=20 00:21:20.104 lat (usec) : 750=0.01%, 1000=0.07% 00:21:20.104 lat (msec) : 2=0.25%, 4=0.37%, 10=1.98%, 20=27.24%, 50=49.78% 00:21:20.104 lat (msec) : 100=17.88%, 250=2.43% 00:21:20.104 cpu : usr=3.34%, sys=4.28%, ctx=4711, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,17462,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job6: (groupid=0, jobs=1): err= 0: pid=1395701: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=726, BW=182MiB/s (190MB/s)(1821MiB/10025msec); 0 zone resets 00:21:20.104 slat (usec): min=17, max=40389, avg=1246.04, stdev=2592.75 00:21:20.104 clat (msec): min=14, max=151, avg=86.83, stdev=24.64 00:21:20.104 lat (msec): min=14, max=151, avg=88.07, stdev=25.07 00:21:20.104 clat percentiles (msec): 00:21:20.104 | 1.00th=[ 25], 5.00th=[ 36], 10.00th=[ 50], 20.00th=[ 68], 00:21:20.104 | 30.00th=[ 78], 40.00th=[ 86], 50.00th=[ 93], 60.00th=[ 99], 00:21:20.104 | 70.00th=[ 102], 80.00th=[ 107], 90.00th=[ 114], 95.00th=[ 121], 00:21:20.104 | 99.00th=[ 129], 99.50th=[ 134], 99.90th=[ 144], 99.95th=[ 148], 00:21:20.104 | 99.99th=[ 153] 00:21:20.104 bw ( KiB/s): min=141312, max=316928, per=5.13%, avg=184817.15, stdev=43755.50, samples=20 00:21:20.104 iops : min= 552, max= 1238, avg=721.90, stdev=170.96, samples=20 00:21:20.104 lat (msec) : 20=0.54%, 50=9.73%, 100=54.84%, 250=34.89% 00:21:20.104 cpu : usr=1.72%, sys=2.08%, ctx=2162, majf=0, minf=1 00:21:20.104 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:20.104 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.104 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.104 issued rwts: total=0,7283,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.104 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.104 job7: (groupid=0, jobs=1): err= 0: pid=1395706: Tue Apr 23 21:22:13 2024 00:21:20.104 write: IOPS=762, BW=191MiB/s (200MB/s)(1916MiB/10053msec); 0 zone resets 00:21:20.104 slat (usec): min=13, max=23194, avg=1180.98, stdev=2530.00 00:21:20.104 clat (usec): min=676, max=137199, avg=82736.73, stdev=29206.16 00:21:20.104 lat (usec): min=735, max=140978, avg=83917.72, stdev=29710.55 00:21:20.104 clat percentiles (msec): 00:21:20.104 | 1.00th=[ 4], 5.00th=[ 22], 10.00th=[ 37], 20.00th=[ 60], 00:21:20.104 | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 91], 60.00th=[ 97], 00:21:20.104 | 70.00th=[ 102], 80.00th=[ 106], 90.00th=[ 113], 95.00th=[ 121], 00:21:20.104 | 99.00th=[ 126], 99.50th=[ 129], 99.90th=[ 136], 99.95th=[ 136], 00:21:20.104 | 99.99th=[ 138] 00:21:20.105 bw ( KiB/s): min=136704, max=359936, per=5.40%, avg=194596.45, stdev=61847.60, samples=20 00:21:20.105 iops : min= 534, max= 1406, avg=760.10, stdev=241.63, samples=20 00:21:20.105 lat (usec) : 750=0.04%, 1000=0.07% 00:21:20.105 lat (msec) : 2=0.55%, 4=0.44%, 10=1.07%, 20=2.09%, 50=12.58% 00:21:20.105 lat (msec) : 100=49.55%, 250=33.62% 00:21:20.105 cpu : usr=1.57%, sys=2.42%, ctx=2438, majf=0, minf=1 00:21:20.105 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:20.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.105 issued rwts: total=0,7665,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.105 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.105 job8: (groupid=0, jobs=1): err= 0: pid=1395721: Tue Apr 23 21:22:13 2024 00:21:20.105 write: IOPS=1282, BW=321MiB/s (336MB/s)(3223MiB/10053msec); 0 zone resets 00:21:20.105 slat (usec): min=17, max=51919, avg=655.61, stdev=1767.57 00:21:20.105 clat (msec): min=5, max=160, avg=49.24, stdev=30.34 00:21:20.105 lat (msec): min=5, max=162, avg=49.90, stdev=30.73 00:21:20.105 clat percentiles (msec): 00:21:20.105 | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 31], 00:21:20.105 | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 36], 60.00th=[ 41], 00:21:20.105 | 70.00th=[ 49], 80.00th=[ 81], 90.00th=[ 103], 95.00th=[ 112], 00:21:20.105 | 99.00th=[ 131], 99.50th=[ 138], 99.90th=[ 157], 99.95th=[ 159], 00:21:20.105 | 99.99th=[ 161] 00:21:20.105 bw ( KiB/s): min=138752, max=621568, per=9.11%, avg=328376.85, stdev=152027.62, samples=20 00:21:20.105 iops : min= 542, max= 2428, avg=1282.70, stdev=593.88, samples=20 00:21:20.105 lat (msec) : 10=0.30%, 20=10.75%, 50=60.30%, 100=16.86%, 250=11.79% 00:21:20.105 cpu : usr=2.68%, sys=3.38%, ctx=3604, majf=0, minf=1 00:21:20.105 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:20.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.105 issued rwts: total=0,12891,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.105 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.105 job9: (groupid=0, jobs=1): err= 0: pid=1395730: Tue Apr 23 21:22:13 2024 00:21:20.105 write: IOPS=1247, BW=312MiB/s (327MB/s)(3126MiB/10025msec); 0 zone resets 00:21:20.105 slat (usec): min=12, max=80890, avg=632.67, stdev=2083.35 00:21:20.105 clat (usec): min=859, max=198889, avg=50674.84, stdev=34561.63 00:21:20.105 lat (usec): min=921, max=198942, avg=51307.50, stdev=34967.77 00:21:20.105 clat percentiles (msec): 00:21:20.105 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 17], 20.00th=[ 22], 00:21:20.105 | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 46], 00:21:20.105 | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 105], 95.00th=[ 113], 00:21:20.105 | 99.00th=[ 129], 99.50th=[ 134], 99.90th=[ 171], 99.95th=[ 188], 00:21:20.105 | 99.99th=[ 190] 00:21:20.105 bw ( KiB/s): min=145117, max=739328, per=8.84%, avg=318423.85, stdev=177865.27, samples=20 00:21:20.105 iops : min= 566, max= 2888, avg=1243.80, stdev=694.83, samples=20 00:21:20.105 lat (usec) : 1000=0.04% 00:21:20.105 lat (msec) : 2=0.22%, 4=1.37%, 10=2.94%, 20=14.18%, 50=44.83% 00:21:20.105 lat (msec) : 100=22.51%, 250=13.91% 00:21:20.105 cpu : usr=2.46%, sys=3.42%, ctx=3910, majf=0, minf=1 00:21:20.105 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:20.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.105 issued rwts: total=0,12502,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.105 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.105 job10: (groupid=0, jobs=1): err= 0: pid=1395736: Tue Apr 23 21:22:13 2024 00:21:20.105 write: IOPS=1742, BW=436MiB/s (457MB/s)(4378MiB/10053msec); 0 zone resets 00:21:20.105 slat (usec): min=17, max=39809, avg=547.16, stdev=1353.09 00:21:20.105 clat (usec): min=498, max=126716, avg=36182.34, stdev=15899.62 00:21:20.105 lat (usec): min=531, max=126767, avg=36729.50, stdev=16137.45 00:21:20.105 clat percentiles (msec): 00:21:20.105 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], 00:21:20.105 | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 35], 60.00th=[ 37], 00:21:20.105 | 70.00th=[ 45], 80.00th=[ 51], 90.00th=[ 58], 95.00th=[ 65], 00:21:20.105 | 99.00th=[ 74], 99.50th=[ 81], 99.90th=[ 92], 99.95th=[ 107], 00:21:20.105 | 99.99th=[ 127] 00:21:20.105 bw ( KiB/s): min=232960, max=725504, per=12.40%, avg=446663.05, stdev=150855.22, samples=20 00:21:20.105 iops : min= 910, max= 2834, avg=1744.75, stdev=589.30, samples=20 00:21:20.105 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.09% 00:21:20.105 lat (msec) : 2=0.29%, 4=0.69%, 10=2.09%, 20=18.49%, 50=58.09% 00:21:20.105 lat (msec) : 100=20.18%, 250=0.06% 00:21:20.105 cpu : usr=3.89%, sys=4.35%, ctx=4237, majf=0, minf=1 00:21:20.105 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:20.105 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:20.105 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:20.105 issued rwts: total=0,17513,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:20.105 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:20.105 00:21:20.105 Run status group 0 (all jobs): 00:21:20.105 WRITE: bw=3519MiB/s (3690MB/s), 182MiB/s-436MiB/s (190MB/s-457MB/s), io=34.6GiB (37.1GB), run=10013-10055msec 00:21:20.105 00:21:20.105 Disk stats (read/write): 00:21:20.105 nvme0n1: ios=49/20832, merge=0/0, ticks=13/1239916, in_queue=1239929, util=97.77% 00:21:20.105 nvme10n1: ios=0/33443, merge=0/0, ticks=0/1238273, in_queue=1238273, util=97.88% 00:21:20.105 nvme1n1: ios=0/28116, merge=0/0, ticks=0/1237174, in_queue=1237174, util=98.07% 00:21:20.105 nvme2n1: ios=0/31272, merge=0/0, ticks=0/1239251, in_queue=1239251, util=98.16% 00:21:20.105 nvme3n1: ios=0/17968, merge=0/0, ticks=0/1232645, in_queue=1232645, util=98.21% 00:21:20.105 nvme4n1: ios=0/34787, merge=0/0, ticks=0/1235290, in_queue=1235290, util=98.42% 00:21:20.105 nvme5n1: ios=0/14396, merge=0/0, ticks=0/1233171, in_queue=1233171, util=98.53% 00:21:20.105 nvme6n1: ios=0/15181, merge=0/0, ticks=0/1230534, in_queue=1230534, util=98.61% 00:21:20.105 nvme7n1: ios=0/25632, merge=0/0, ticks=0/1237129, in_queue=1237129, util=98.85% 00:21:20.105 nvme8n1: ios=0/24833, merge=0/0, ticks=0/1239327, in_queue=1239327, util=98.97% 00:21:20.105 nvme9n1: ios=0/34880, merge=0/0, ticks=0/1233515, in_queue=1233515, util=99.05% 00:21:20.105 21:22:13 -- target/multiconnection.sh@36 -- # sync 00:21:20.105 21:22:13 -- target/multiconnection.sh@37 -- # seq 1 11 00:21:20.105 21:22:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:20.105 21:22:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:20.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:20.105 21:22:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:21:20.105 21:22:14 -- common/autotest_common.sh@1205 -- # local i=0 00:21:20.105 21:22:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:20.105 21:22:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:21:20.363 21:22:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:20.363 21:22:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK1 00:21:20.363 21:22:14 -- common/autotest_common.sh@1217 -- # return 0 00:21:20.363 21:22:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:20.363 21:22:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:20.363 21:22:14 -- common/autotest_common.sh@10 -- # set +x 00:21:20.363 21:22:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:20.363 21:22:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:20.363 21:22:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:21:21.296 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:21:21.296 21:22:15 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:21:21.296 21:22:15 -- common/autotest_common.sh@1205 -- # local i=0 00:21:21.296 21:22:15 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:21.296 21:22:15 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:21:21.296 21:22:15 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:21.296 21:22:15 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK2 00:21:21.296 21:22:15 -- common/autotest_common.sh@1217 -- # return 0 00:21:21.296 21:22:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:21.296 21:22:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:21.296 21:22:15 -- common/autotest_common.sh@10 -- # set +x 00:21:21.296 21:22:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:21.296 21:22:15 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:21.296 21:22:15 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:21:22.335 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:21:22.335 21:22:16 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:21:22.335 21:22:16 -- common/autotest_common.sh@1205 -- # local i=0 00:21:22.335 21:22:16 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:22.335 21:22:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:21:22.335 21:22:16 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:22.335 21:22:16 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK3 00:21:22.335 21:22:16 -- common/autotest_common.sh@1217 -- # return 0 00:21:22.335 21:22:16 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:21:22.335 21:22:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:22.335 21:22:16 -- common/autotest_common.sh@10 -- # set +x 00:21:22.335 21:22:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:22.335 21:22:16 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:22.335 21:22:16 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:21:23.269 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:21:23.269 21:22:17 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:21:23.269 21:22:17 -- common/autotest_common.sh@1205 -- # local i=0 00:21:23.269 21:22:17 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:23.269 21:22:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:21:23.269 21:22:17 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK4 00:21:23.269 21:22:17 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:23.269 21:22:17 -- common/autotest_common.sh@1217 -- # return 0 00:21:23.269 21:22:17 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:21:23.269 21:22:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.269 21:22:17 -- common/autotest_common.sh@10 -- # set +x 00:21:23.269 21:22:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.269 21:22:17 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:23.269 21:22:17 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:21:24.203 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:21:24.203 21:22:18 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:21:24.203 21:22:18 -- common/autotest_common.sh@1205 -- # local i=0 00:21:24.203 21:22:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:24.203 21:22:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:21:24.203 21:22:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK5 00:21:24.203 21:22:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:24.203 21:22:18 -- common/autotest_common.sh@1217 -- # return 0 00:21:24.203 21:22:18 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:21:24.203 21:22:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:24.203 21:22:18 -- common/autotest_common.sh@10 -- # set +x 00:21:24.203 21:22:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:24.203 21:22:18 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:24.203 21:22:18 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:21:25.137 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:21:25.137 21:22:19 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:21:25.137 21:22:19 -- common/autotest_common.sh@1205 -- # local i=0 00:21:25.137 21:22:19 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:25.137 21:22:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:21:25.137 21:22:19 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:25.137 21:22:19 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK6 00:21:25.137 21:22:19 -- common/autotest_common.sh@1217 -- # return 0 00:21:25.137 21:22:19 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:21:25.137 21:22:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:25.137 21:22:19 -- common/autotest_common.sh@10 -- # set +x 00:21:25.137 21:22:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:25.137 21:22:19 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:25.137 21:22:19 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:21:26.070 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:21:26.070 21:22:20 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:21:26.070 21:22:20 -- common/autotest_common.sh@1205 -- # local i=0 00:21:26.070 21:22:20 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:26.070 21:22:20 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:21:26.070 21:22:20 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:26.070 21:22:20 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK7 00:21:26.070 21:22:20 -- common/autotest_common.sh@1217 -- # return 0 00:21:26.070 21:22:20 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:21:26.070 21:22:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:26.070 21:22:20 -- common/autotest_common.sh@10 -- # set +x 00:21:26.070 21:22:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:26.070 21:22:20 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:26.070 21:22:20 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:21:27.004 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:21:27.004 21:22:21 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:21:27.004 21:22:21 -- common/autotest_common.sh@1205 -- # local i=0 00:21:27.004 21:22:21 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:27.004 21:22:21 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:21:27.004 21:22:21 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:27.004 21:22:21 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK8 00:21:27.004 21:22:21 -- common/autotest_common.sh@1217 -- # return 0 00:21:27.004 21:22:21 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:21:27.004 21:22:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:27.004 21:22:21 -- common/autotest_common.sh@10 -- # set +x 00:21:27.262 21:22:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:27.262 21:22:21 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:27.262 21:22:21 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:21:28.195 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:21:28.196 21:22:22 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:21:28.196 21:22:22 -- common/autotest_common.sh@1205 -- # local i=0 00:21:28.196 21:22:22 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:28.196 21:22:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:21:28.196 21:22:22 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:28.196 21:22:22 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK9 00:21:28.196 21:22:22 -- common/autotest_common.sh@1217 -- # return 0 00:21:28.196 21:22:22 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:21:28.196 21:22:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.196 21:22:22 -- common/autotest_common.sh@10 -- # set +x 00:21:28.196 21:22:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.196 21:22:22 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:28.196 21:22:22 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:21:29.133 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:21:29.133 21:22:23 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:21:29.133 21:22:23 -- common/autotest_common.sh@1205 -- # local i=0 00:21:29.133 21:22:23 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:29.133 21:22:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:21:29.133 21:22:23 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK10 00:21:29.133 21:22:23 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:29.133 21:22:23 -- common/autotest_common.sh@1217 -- # return 0 00:21:29.133 21:22:23 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:21:29.133 21:22:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:29.133 21:22:23 -- common/autotest_common.sh@10 -- # set +x 00:21:29.133 21:22:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:29.133 21:22:23 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:29.133 21:22:23 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:21:30.064 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:21:30.064 21:22:24 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:21:30.064 21:22:24 -- common/autotest_common.sh@1205 -- # local i=0 00:21:30.064 21:22:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:30.064 21:22:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:21:30.064 21:22:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK11 00:21:30.064 21:22:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:30.064 21:22:24 -- common/autotest_common.sh@1217 -- # return 0 00:21:30.064 21:22:24 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:21:30.064 21:22:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:30.064 21:22:24 -- common/autotest_common.sh@10 -- # set +x 00:21:30.064 21:22:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:30.064 21:22:24 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:21:30.064 21:22:24 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:21:30.064 21:22:24 -- target/multiconnection.sh@47 -- # nvmftestfini 00:21:30.064 21:22:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:30.064 21:22:24 -- nvmf/common.sh@117 -- # sync 00:21:30.064 21:22:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:30.064 21:22:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:30.064 21:22:24 -- nvmf/common.sh@120 -- # set +e 00:21:30.064 21:22:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:30.064 21:22:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:30.064 rmmod nvme_rdma 00:21:30.064 rmmod nvme_fabrics 00:21:30.064 21:22:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:30.064 21:22:24 -- nvmf/common.sh@124 -- # set -e 00:21:30.064 21:22:24 -- nvmf/common.sh@125 -- # return 0 00:21:30.064 21:22:24 -- nvmf/common.sh@478 -- # '[' -n 1386984 ']' 00:21:30.064 21:22:24 -- nvmf/common.sh@479 -- # killprocess 1386984 00:21:30.064 21:22:24 -- common/autotest_common.sh@936 -- # '[' -z 1386984 ']' 00:21:30.064 21:22:24 -- common/autotest_common.sh@940 -- # kill -0 1386984 00:21:30.064 21:22:24 -- common/autotest_common.sh@941 -- # uname 00:21:30.064 21:22:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.064 21:22:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1386984 00:21:30.064 21:22:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:30.064 21:22:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:30.064 21:22:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1386984' 00:21:30.064 killing process with pid 1386984 00:21:30.064 21:22:24 -- common/autotest_common.sh@955 -- # kill 1386984 00:21:30.064 21:22:24 -- common/autotest_common.sh@960 -- # wait 1386984 00:21:30.322 [2024-04-23 21:22:24.372594] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:30.580 21:22:24 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:30.580 21:22:24 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:30.580 00:21:30.580 real 1m12.903s 00:21:30.580 user 4m47.290s 00:21:30.580 sys 0m15.530s 00:21:30.580 21:22:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:30.580 21:22:24 -- common/autotest_common.sh@10 -- # set +x 00:21:30.580 ************************************ 00:21:30.580 END TEST nvmf_multiconnection 00:21:30.580 ************************************ 00:21:30.580 21:22:24 -- nvmf/nvmf.sh@67 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:30.580 21:22:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:30.580 21:22:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:30.581 21:22:24 -- common/autotest_common.sh@10 -- # set +x 00:21:30.839 ************************************ 00:21:30.839 START TEST nvmf_initiator_timeout 00:21:30.839 ************************************ 00:21:30.839 21:22:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:30.839 * Looking for test storage... 00:21:30.839 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:21:30.839 21:22:25 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:30.839 21:22:25 -- nvmf/common.sh@7 -- # uname -s 00:21:30.839 21:22:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:30.839 21:22:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:30.839 21:22:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:30.839 21:22:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:30.839 21:22:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:30.839 21:22:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:30.839 21:22:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:30.839 21:22:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:30.839 21:22:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:30.839 21:22:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:30.839 21:22:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:21:30.839 21:22:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:21:30.839 21:22:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:30.839 21:22:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:30.839 21:22:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:30.839 21:22:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:30.839 21:22:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:30.839 21:22:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:30.839 21:22:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:30.839 21:22:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:30.839 21:22:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.839 21:22:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.839 21:22:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.839 21:22:25 -- paths/export.sh@5 -- # export PATH 00:21:30.839 21:22:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:30.839 21:22:25 -- nvmf/common.sh@47 -- # : 0 00:21:30.839 21:22:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:30.839 21:22:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:30.839 21:22:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:30.839 21:22:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:30.839 21:22:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:30.839 21:22:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:30.839 21:22:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:30.839 21:22:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:30.839 21:22:25 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:30.839 21:22:25 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:30.839 21:22:25 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:21:30.839 21:22:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:30.839 21:22:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:30.839 21:22:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:30.839 21:22:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:30.839 21:22:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:30.839 21:22:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.839 21:22:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.839 21:22:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.839 21:22:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:30.839 21:22:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:30.839 21:22:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:30.839 21:22:25 -- common/autotest_common.sh@10 -- # set +x 00:21:36.108 21:22:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:36.108 21:22:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:36.109 21:22:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:36.109 21:22:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:36.109 21:22:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:36.109 21:22:30 -- nvmf/common.sh@295 -- # net_devs=() 00:21:36.109 21:22:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@296 -- # e810=() 00:21:36.109 21:22:30 -- nvmf/common.sh@296 -- # local -ga e810 00:21:36.109 21:22:30 -- nvmf/common.sh@297 -- # x722=() 00:21:36.109 21:22:30 -- nvmf/common.sh@297 -- # local -ga x722 00:21:36.109 21:22:30 -- nvmf/common.sh@298 -- # mlx=() 00:21:36.109 21:22:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:36.109 21:22:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:36.109 21:22:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:36.109 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:36.109 21:22:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:36.109 21:22:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:36.109 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:36.109 21:22:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:36.109 21:22:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:36.109 21:22:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:36.109 21:22:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:36.109 Found net devices under 0000:18:00.0: mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:36.109 21:22:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:36.109 21:22:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:36.109 Found net devices under 0000:18:00.1: mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:36.109 21:22:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:36.109 21:22:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:36.109 21:22:30 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:36.109 21:22:30 -- nvmf/common.sh@58 -- # uname 00:21:36.109 21:22:30 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:36.109 21:22:30 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:36.109 21:22:30 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:36.109 21:22:30 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:36.109 21:22:30 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:36.109 21:22:30 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:36.109 21:22:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:36.109 21:22:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:36.109 21:22:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:36.109 21:22:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:36.109 21:22:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:36.109 21:22:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:36.109 21:22:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:36.109 21:22:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@105 -- # continue 2 00:21:36.109 21:22:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@105 -- # continue 2 00:21:36.109 21:22:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:36.109 21:22:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:36.109 21:22:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:36.109 21:22:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:36.109 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:36.109 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:21:36.109 altname enp24s0f0np0 00:21:36.109 altname ens785f0np0 00:21:36.109 inet 192.168.100.8/24 scope global mlx_0_0 00:21:36.109 valid_lft forever preferred_lft forever 00:21:36.109 21:22:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:36.109 21:22:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:36.109 21:22:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:36.109 21:22:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:36.109 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:36.109 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:21:36.109 altname enp24s0f1np1 00:21:36.109 altname ens785f1np1 00:21:36.109 inet 192.168.100.9/24 scope global mlx_0_1 00:21:36.109 valid_lft forever preferred_lft forever 00:21:36.109 21:22:30 -- nvmf/common.sh@411 -- # return 0 00:21:36.109 21:22:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:36.109 21:22:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:36.109 21:22:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:36.109 21:22:30 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:36.109 21:22:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:36.109 21:22:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:36.109 21:22:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:36.109 21:22:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:36.109 21:22:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@105 -- # continue 2 00:21:36.109 21:22:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:36.109 21:22:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:36.109 21:22:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:36.109 21:22:30 -- nvmf/common.sh@105 -- # continue 2 00:21:36.109 21:22:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:36.109 21:22:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:36.109 21:22:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:36.110 21:22:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:36.110 21:22:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:36.110 21:22:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:36.110 21:22:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:36.110 21:22:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:36.110 21:22:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:36.110 21:22:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:36.110 21:22:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:36.110 21:22:30 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:36.110 192.168.100.9' 00:21:36.110 21:22:30 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:36.110 192.168.100.9' 00:21:36.110 21:22:30 -- nvmf/common.sh@446 -- # head -n 1 00:21:36.110 21:22:30 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:36.110 21:22:30 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:36.110 192.168.100.9' 00:21:36.110 21:22:30 -- nvmf/common.sh@447 -- # tail -n +2 00:21:36.110 21:22:30 -- nvmf/common.sh@447 -- # head -n 1 00:21:36.110 21:22:30 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:36.110 21:22:30 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:36.110 21:22:30 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:36.110 21:22:30 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:36.110 21:22:30 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:36.110 21:22:30 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:36.110 21:22:30 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:21:36.110 21:22:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:36.110 21:22:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:36.110 21:22:30 -- common/autotest_common.sh@10 -- # set +x 00:21:36.110 21:22:30 -- nvmf/common.sh@470 -- # nvmfpid=1402945 00:21:36.110 21:22:30 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:36.110 21:22:30 -- nvmf/common.sh@471 -- # waitforlisten 1402945 00:21:36.110 21:22:30 -- common/autotest_common.sh@817 -- # '[' -z 1402945 ']' 00:21:36.110 21:22:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:36.110 21:22:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:36.110 21:22:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:36.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:36.110 21:22:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:36.110 21:22:30 -- common/autotest_common.sh@10 -- # set +x 00:21:36.110 [2024-04-23 21:22:30.326697] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:21:36.110 [2024-04-23 21:22:30.326747] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:36.110 EAL: No free 2048 kB hugepages reported on node 1 00:21:36.110 [2024-04-23 21:22:30.379135] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:36.368 [2024-04-23 21:22:30.452782] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:36.368 [2024-04-23 21:22:30.452819] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:36.368 [2024-04-23 21:22:30.452826] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:36.368 [2024-04-23 21:22:30.452835] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:36.368 [2024-04-23 21:22:30.452840] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:36.368 [2024-04-23 21:22:30.452882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:36.368 [2024-04-23 21:22:30.452976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:36.368 [2024-04-23 21:22:30.453048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:36.368 [2024-04-23 21:22:30.453050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:36.933 21:22:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:36.933 21:22:31 -- common/autotest_common.sh@850 -- # return 0 00:21:36.933 21:22:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:36.933 21:22:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:36.933 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:36.933 21:22:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:36.933 21:22:31 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:36.933 21:22:31 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:36.933 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.933 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:36.933 Malloc0 00:21:36.933 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.933 21:22:31 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:21:36.933 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.933 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:36.933 Delay0 00:21:36.933 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:36.933 21:22:31 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:36.933 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:36.933 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:36.933 [2024-04-23 21:22:31.196396] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x208d050/0x2115880) succeed. 00:21:37.191 [2024-04-23 21:22:31.205811] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x208e320/0x2095840) succeed. 00:21:37.191 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.191 21:22:31 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:21:37.191 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.191 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:37.191 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.191 21:22:31 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:21:37.191 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.191 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:37.191 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.191 21:22:31 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:37.191 21:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:37.191 21:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:37.191 [2024-04-23 21:22:31.342985] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:37.191 21:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:37.191 21:22:31 -- target/initiator_timeout.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:21:38.122 21:22:32 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:21:38.122 21:22:32 -- common/autotest_common.sh@1184 -- # local i=0 00:21:38.122 21:22:32 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:38.122 21:22:32 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:38.122 21:22:32 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:40.646 21:22:34 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:40.646 21:22:34 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:40.646 21:22:34 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:21:40.646 21:22:34 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:40.646 21:22:34 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:40.646 21:22:34 -- common/autotest_common.sh@1194 -- # return 0 00:21:40.646 21:22:34 -- target/initiator_timeout.sh@35 -- # fio_pid=1403685 00:21:40.646 21:22:34 -- target/initiator_timeout.sh@37 -- # sleep 3 00:21:40.646 21:22:34 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:21:40.646 [global] 00:21:40.646 thread=1 00:21:40.646 invalidate=1 00:21:40.646 rw=write 00:21:40.646 time_based=1 00:21:40.646 runtime=60 00:21:40.646 ioengine=libaio 00:21:40.646 direct=1 00:21:40.646 bs=4096 00:21:40.646 iodepth=1 00:21:40.646 norandommap=0 00:21:40.646 numjobs=1 00:21:40.646 00:21:40.646 verify_dump=1 00:21:40.646 verify_backlog=512 00:21:40.646 verify_state_save=0 00:21:40.646 do_verify=1 00:21:40.646 verify=crc32c-intel 00:21:40.646 [job0] 00:21:40.646 filename=/dev/nvme0n1 00:21:40.646 Could not set queue depth (nvme0n1) 00:21:40.646 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:21:40.646 fio-3.35 00:21:40.646 Starting 1 thread 00:21:43.172 21:22:37 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:21:43.172 21:22:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.172 21:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:43.172 true 00:21:43.172 21:22:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.172 21:22:37 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:21:43.172 21:22:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.172 21:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:43.172 true 00:21:43.172 21:22:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.172 21:22:37 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:21:43.172 21:22:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.172 21:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:43.172 true 00:21:43.172 21:22:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.172 21:22:37 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:21:43.172 21:22:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.172 21:22:37 -- common/autotest_common.sh@10 -- # set +x 00:21:43.172 true 00:21:43.172 21:22:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.172 21:22:37 -- target/initiator_timeout.sh@45 -- # sleep 3 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:21:46.453 21:22:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.453 21:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:46.453 true 00:21:46.453 21:22:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:21:46.453 21:22:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.453 21:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:46.453 true 00:21:46.453 21:22:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:21:46.453 21:22:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.453 21:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:46.453 true 00:21:46.453 21:22:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:21:46.453 21:22:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.453 21:22:40 -- common/autotest_common.sh@10 -- # set +x 00:21:46.453 true 00:21:46.453 21:22:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:21:46.453 21:22:40 -- target/initiator_timeout.sh@54 -- # wait 1403685 00:22:42.668 00:22:42.668 job0: (groupid=0, jobs=1): err= 0: pid=1403954: Tue Apr 23 21:23:34 2024 00:22:42.668 read: IOPS=1356, BW=5427KiB/s (5557kB/s)(318MiB/60000msec) 00:22:42.668 slat (nsec): min=5876, max=66078, avg=6909.92, stdev=926.59 00:22:42.668 clat (usec): min=69, max=776, avg=99.10, stdev= 7.26 00:22:42.668 lat (usec): min=89, max=783, avg=106.01, stdev= 7.33 00:22:42.668 clat percentiles (usec): 00:22:42.668 | 1.00th=[ 88], 5.00th=[ 91], 10.00th=[ 92], 20.00th=[ 94], 00:22:42.668 | 30.00th=[ 96], 40.00th=[ 97], 50.00th=[ 99], 60.00th=[ 100], 00:22:42.668 | 70.00th=[ 102], 80.00th=[ 104], 90.00th=[ 108], 95.00th=[ 110], 00:22:42.668 | 99.00th=[ 115], 99.50th=[ 117], 99.90th=[ 125], 99.95th=[ 145], 00:22:42.668 | 99.99th=[ 289] 00:22:42.668 write: IOPS=1358, BW=5436KiB/s (5566kB/s)(319MiB/60000msec); 0 zone resets 00:22:42.668 slat (usec): min=7, max=13017, avg= 9.34, stdev=50.00 00:22:42.668 clat (usec): min=73, max=42420k, avg=616.34, stdev=148553.66 00:22:42.668 lat (usec): min=87, max=42420k, avg=625.68, stdev=148553.67 00:22:42.668 clat percentiles (usec): 00:22:42.668 | 1.00th=[ 85], 5.00th=[ 88], 10.00th=[ 89], 20.00th=[ 91], 00:22:42.668 | 30.00th=[ 93], 40.00th=[ 94], 50.00th=[ 96], 60.00th=[ 97], 00:22:42.668 | 70.00th=[ 99], 80.00th=[ 101], 90.00th=[ 104], 95.00th=[ 108], 00:22:42.668 | 99.00th=[ 113], 99.50th=[ 116], 99.90th=[ 124], 99.95th=[ 137], 00:22:42.668 | 99.99th=[ 239] 00:22:42.668 bw ( KiB/s): min= 104, max=20480, per=100.00%, avg=17664.89, stdev=4179.84, samples=36 00:22:42.668 iops : min= 26, max= 5120, avg=4416.22, stdev=1044.96, samples=36 00:22:42.668 lat (usec) : 100=67.10%, 250=32.88%, 500=0.01%, 750=0.01%, 1000=0.01% 00:22:42.668 lat (msec) : >=2000=0.01% 00:22:42.668 cpu : usr=1.38%, sys=2.18%, ctx=162954, majf=0, minf=108 00:22:42.668 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:42.668 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:42.668 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:42.668 issued rwts: total=81408,81539,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:42.668 latency : target=0, window=0, percentile=100.00%, depth=1 00:22:42.668 00:22:42.668 Run status group 0 (all jobs): 00:22:42.668 READ: bw=5427KiB/s (5557kB/s), 5427KiB/s-5427KiB/s (5557kB/s-5557kB/s), io=318MiB (333MB), run=60000-60000msec 00:22:42.668 WRITE: bw=5436KiB/s (5566kB/s), 5436KiB/s-5436KiB/s (5566kB/s-5566kB/s), io=319MiB (334MB), run=60000-60000msec 00:22:42.668 00:22:42.668 Disk stats (read/write): 00:22:42.668 nvme0n1: ios=81236/81122, merge=0/0, ticks=7749/7372, in_queue=15121, util=99.71% 00:22:42.668 21:23:34 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:42.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:22:42.668 21:23:35 -- common/autotest_common.sh@1205 -- # local i=0 00:22:42.668 21:23:35 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:42.668 21:23:35 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:42.668 21:23:35 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:42.668 21:23:35 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:42.668 21:23:35 -- common/autotest_common.sh@1217 -- # return 0 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:22:42.668 nvmf hotplug test: fio successful as expected 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:42.668 21:23:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:42.668 21:23:35 -- common/autotest_common.sh@10 -- # set +x 00:22:42.668 21:23:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:22:42.668 21:23:35 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:22:42.668 21:23:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:42.668 21:23:35 -- nvmf/common.sh@117 -- # sync 00:22:42.668 21:23:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:42.668 21:23:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:42.668 21:23:35 -- nvmf/common.sh@120 -- # set +e 00:22:42.668 21:23:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:42.668 21:23:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:42.668 rmmod nvme_rdma 00:22:42.668 rmmod nvme_fabrics 00:22:42.668 21:23:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:42.668 21:23:35 -- nvmf/common.sh@124 -- # set -e 00:22:42.668 21:23:35 -- nvmf/common.sh@125 -- # return 0 00:22:42.668 21:23:35 -- nvmf/common.sh@478 -- # '[' -n 1402945 ']' 00:22:42.668 21:23:35 -- nvmf/common.sh@479 -- # killprocess 1402945 00:22:42.668 21:23:35 -- common/autotest_common.sh@936 -- # '[' -z 1402945 ']' 00:22:42.668 21:23:35 -- common/autotest_common.sh@940 -- # kill -0 1402945 00:22:42.668 21:23:35 -- common/autotest_common.sh@941 -- # uname 00:22:42.668 21:23:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:42.668 21:23:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1402945 00:22:42.668 21:23:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:42.668 21:23:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:42.668 21:23:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1402945' 00:22:42.668 killing process with pid 1402945 00:22:42.668 21:23:35 -- common/autotest_common.sh@955 -- # kill 1402945 00:22:42.668 21:23:35 -- common/autotest_common.sh@960 -- # wait 1402945 00:22:42.668 [2024-04-23 21:23:35.958598] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:42.668 21:23:36 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:42.668 21:23:36 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:42.668 00:22:42.668 real 1m11.240s 00:22:42.668 user 4m31.109s 00:22:42.668 sys 0m6.689s 00:22:42.668 21:23:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:42.668 21:23:36 -- common/autotest_common.sh@10 -- # set +x 00:22:42.668 ************************************ 00:22:42.668 END TEST nvmf_initiator_timeout 00:22:42.668 ************************************ 00:22:42.668 21:23:36 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:22:42.668 21:23:36 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:22:42.668 21:23:36 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:22:42.668 21:23:36 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:22:42.668 21:23:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:42.668 21:23:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:42.668 21:23:36 -- common/autotest_common.sh@10 -- # set +x 00:22:42.668 ************************************ 00:22:42.668 START TEST nvmf_device_removal 00:22:42.668 ************************************ 00:22:42.668 21:23:36 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:22:42.668 * Looking for test storage... 00:22:42.668 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.668 21:23:36 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:22:42.668 21:23:36 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:22:42.668 21:23:36 -- common/autotest_common.sh@34 -- # set -e 00:22:42.668 21:23:36 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:22:42.668 21:23:36 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:22:42.668 21:23:36 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:22:42.668 21:23:36 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:22:42.668 21:23:36 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:22:42.668 21:23:36 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:22:42.668 21:23:36 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:22:42.668 21:23:36 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:22:42.668 21:23:36 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:22:42.668 21:23:36 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:22:42.668 21:23:36 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:22:42.668 21:23:36 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:22:42.668 21:23:36 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:22:42.668 21:23:36 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:22:42.668 21:23:36 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:22:42.668 21:23:36 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:22:42.668 21:23:36 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:22:42.668 21:23:36 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:22:42.668 21:23:36 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:22:42.669 21:23:36 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:22:42.669 21:23:36 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:22:42.669 21:23:36 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:22:42.669 21:23:36 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:22:42.669 21:23:36 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:22:42.669 21:23:36 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:22:42.669 21:23:36 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:22:42.669 21:23:36 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:22:42.669 21:23:36 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:22:42.669 21:23:36 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:22:42.669 21:23:36 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:22:42.669 21:23:36 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:22:42.669 21:23:36 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:22:42.669 21:23:36 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:22:42.669 21:23:36 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:22:42.669 21:23:36 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:22:42.669 21:23:36 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:22:42.669 21:23:36 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:22:42.669 21:23:36 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:22:42.669 21:23:36 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:22:42.669 21:23:36 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:22:42.669 21:23:36 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:22:42.669 21:23:36 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:22:42.669 21:23:36 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:22:42.669 21:23:36 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:22:42.669 21:23:36 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:22:42.669 21:23:36 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:22:42.669 21:23:36 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:22:42.669 21:23:36 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:22:42.669 21:23:36 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:22:42.669 21:23:36 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:22:42.669 21:23:36 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:22:42.669 21:23:36 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:22:42.669 21:23:36 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:22:42.669 21:23:36 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:22:42.669 21:23:36 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:22:42.669 21:23:36 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:22:42.669 21:23:36 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:22:42.669 21:23:36 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:22:42.669 21:23:36 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:22:42.669 21:23:36 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:22:42.669 21:23:36 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:22:42.669 21:23:36 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:22:42.669 21:23:36 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:22:42.669 21:23:36 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:22:42.669 21:23:36 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:22:42.669 21:23:36 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:22:42.669 21:23:36 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:22:42.669 21:23:36 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:22:42.669 21:23:36 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:22:42.669 21:23:36 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:22:42.669 21:23:36 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:22:42.669 21:23:36 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:22:42.669 21:23:36 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:22:42.669 21:23:36 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:22:42.669 21:23:36 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:22:42.669 21:23:36 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:22:42.669 21:23:36 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:22:42.669 21:23:36 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:22:42.669 21:23:36 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:22:42.669 21:23:36 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:22:42.669 21:23:36 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:22:42.669 21:23:36 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:22:42.669 21:23:36 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:22:42.669 21:23:36 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:22:42.669 21:23:36 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:22:42.669 21:23:36 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:42.669 21:23:36 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:22:42.669 21:23:36 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:22:42.669 21:23:36 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:22:42.669 21:23:36 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:22:42.669 21:23:36 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:22:42.669 21:23:36 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:22:42.669 21:23:36 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:22:42.669 21:23:36 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:22:42.669 21:23:36 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:22:42.669 21:23:36 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:22:42.669 21:23:36 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:22:42.669 #define SPDK_CONFIG_H 00:22:42.669 #define SPDK_CONFIG_APPS 1 00:22:42.669 #define SPDK_CONFIG_ARCH native 00:22:42.669 #undef SPDK_CONFIG_ASAN 00:22:42.669 #undef SPDK_CONFIG_AVAHI 00:22:42.669 #undef SPDK_CONFIG_CET 00:22:42.669 #define SPDK_CONFIG_COVERAGE 1 00:22:42.669 #define SPDK_CONFIG_CROSS_PREFIX 00:22:42.669 #undef SPDK_CONFIG_CRYPTO 00:22:42.669 #undef SPDK_CONFIG_CRYPTO_MLX5 00:22:42.669 #undef SPDK_CONFIG_CUSTOMOCF 00:22:42.669 #undef SPDK_CONFIG_DAOS 00:22:42.669 #define SPDK_CONFIG_DAOS_DIR 00:22:42.669 #define SPDK_CONFIG_DEBUG 1 00:22:42.669 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:22:42.669 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:22:42.669 #define SPDK_CONFIG_DPDK_INC_DIR 00:22:42.669 #define SPDK_CONFIG_DPDK_LIB_DIR 00:22:42.669 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:22:42.669 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:22:42.669 #define SPDK_CONFIG_EXAMPLES 1 00:22:42.669 #undef SPDK_CONFIG_FC 00:22:42.669 #define SPDK_CONFIG_FC_PATH 00:22:42.669 #define SPDK_CONFIG_FIO_PLUGIN 1 00:22:42.669 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:22:42.669 #undef SPDK_CONFIG_FUSE 00:22:42.669 #undef SPDK_CONFIG_FUZZER 00:22:42.669 #define SPDK_CONFIG_FUZZER_LIB 00:22:42.669 #undef SPDK_CONFIG_GOLANG 00:22:42.669 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:22:42.669 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:22:42.669 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:22:42.669 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:22:42.669 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:22:42.669 #undef SPDK_CONFIG_HAVE_LIBBSD 00:22:42.669 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:22:42.669 #define SPDK_CONFIG_IDXD 1 00:22:42.669 #undef SPDK_CONFIG_IDXD_KERNEL 00:22:42.669 #undef SPDK_CONFIG_IPSEC_MB 00:22:42.669 #define SPDK_CONFIG_IPSEC_MB_DIR 00:22:42.669 #define SPDK_CONFIG_ISAL 1 00:22:42.669 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:22:42.669 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:22:42.669 #define SPDK_CONFIG_LIBDIR 00:22:42.669 #undef SPDK_CONFIG_LTO 00:22:42.669 #define SPDK_CONFIG_MAX_LCORES 00:22:42.669 #define SPDK_CONFIG_NVME_CUSE 1 00:22:42.669 #undef SPDK_CONFIG_OCF 00:22:42.669 #define SPDK_CONFIG_OCF_PATH 00:22:42.669 #define SPDK_CONFIG_OPENSSL_PATH 00:22:42.669 #undef SPDK_CONFIG_PGO_CAPTURE 00:22:42.669 #define SPDK_CONFIG_PGO_DIR 00:22:42.669 #undef SPDK_CONFIG_PGO_USE 00:22:42.669 #define SPDK_CONFIG_PREFIX /usr/local 00:22:42.669 #undef SPDK_CONFIG_RAID5F 00:22:42.669 #undef SPDK_CONFIG_RBD 00:22:42.669 #define SPDK_CONFIG_RDMA 1 00:22:42.669 #define SPDK_CONFIG_RDMA_PROV verbs 00:22:42.669 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:22:42.669 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:22:42.669 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:22:42.669 #define SPDK_CONFIG_SHARED 1 00:22:42.669 #undef SPDK_CONFIG_SMA 00:22:42.669 #define SPDK_CONFIG_TESTS 1 00:22:42.669 #undef SPDK_CONFIG_TSAN 00:22:42.669 #define SPDK_CONFIG_UBLK 1 00:22:42.669 #define SPDK_CONFIG_UBSAN 1 00:22:42.669 #undef SPDK_CONFIG_UNIT_TESTS 00:22:42.669 #undef SPDK_CONFIG_URING 00:22:42.669 #define SPDK_CONFIG_URING_PATH 00:22:42.669 #undef SPDK_CONFIG_URING_ZNS 00:22:42.669 #undef SPDK_CONFIG_USDT 00:22:42.669 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:22:42.669 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:22:42.669 #undef SPDK_CONFIG_VFIO_USER 00:22:42.669 #define SPDK_CONFIG_VFIO_USER_DIR 00:22:42.669 #define SPDK_CONFIG_VHOST 1 00:22:42.669 #define SPDK_CONFIG_VIRTIO 1 00:22:42.669 #undef SPDK_CONFIG_VTUNE 00:22:42.669 #define SPDK_CONFIG_VTUNE_DIR 00:22:42.669 #define SPDK_CONFIG_WERROR 1 00:22:42.669 #define SPDK_CONFIG_WPDK_DIR 00:22:42.669 #undef SPDK_CONFIG_XNVME 00:22:42.669 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:22:42.669 21:23:36 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:22:42.669 21:23:36 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:42.669 21:23:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:42.669 21:23:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:42.669 21:23:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:42.670 21:23:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.670 21:23:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.670 21:23:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.670 21:23:36 -- paths/export.sh@5 -- # export PATH 00:22:42.670 21:23:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.670 21:23:36 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:22:42.670 21:23:36 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:22:42.670 21:23:36 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:22:42.670 21:23:36 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:22:42.670 21:23:36 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:22:42.670 21:23:36 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:42.670 21:23:36 -- pm/common@67 -- # TEST_TAG=N/A 00:22:42.670 21:23:36 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:22:42.670 21:23:36 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:22:42.670 21:23:36 -- pm/common@71 -- # uname -s 00:22:42.670 21:23:36 -- pm/common@71 -- # PM_OS=Linux 00:22:42.670 21:23:36 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:22:42.670 21:23:36 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:22:42.670 21:23:36 -- pm/common@76 -- # [[ Linux == Linux ]] 00:22:42.670 21:23:36 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:22:42.670 21:23:36 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:22:42.670 21:23:36 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:22:42.670 21:23:36 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:22:42.670 21:23:36 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:22:42.670 21:23:36 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:22:42.670 21:23:36 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:22:42.670 21:23:36 -- common/autotest_common.sh@57 -- # : 1 00:22:42.670 21:23:36 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:22:42.670 21:23:36 -- common/autotest_common.sh@61 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:22:42.670 21:23:36 -- common/autotest_common.sh@63 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:22:42.670 21:23:36 -- common/autotest_common.sh@65 -- # : 1 00:22:42.670 21:23:36 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:22:42.670 21:23:36 -- common/autotest_common.sh@67 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:22:42.670 21:23:36 -- common/autotest_common.sh@69 -- # : 00:22:42.670 21:23:36 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:22:42.670 21:23:36 -- common/autotest_common.sh@71 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:22:42.670 21:23:36 -- common/autotest_common.sh@73 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:22:42.670 21:23:36 -- common/autotest_common.sh@75 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:22:42.670 21:23:36 -- common/autotest_common.sh@77 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:22:42.670 21:23:36 -- common/autotest_common.sh@79 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:22:42.670 21:23:36 -- common/autotest_common.sh@81 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:22:42.670 21:23:36 -- common/autotest_common.sh@83 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:22:42.670 21:23:36 -- common/autotest_common.sh@85 -- # : 1 00:22:42.670 21:23:36 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:22:42.670 21:23:36 -- common/autotest_common.sh@87 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:22:42.670 21:23:36 -- common/autotest_common.sh@89 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:22:42.670 21:23:36 -- common/autotest_common.sh@91 -- # : 1 00:22:42.670 21:23:36 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:22:42.670 21:23:36 -- common/autotest_common.sh@93 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:22:42.670 21:23:36 -- common/autotest_common.sh@95 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:22:42.670 21:23:36 -- common/autotest_common.sh@97 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:22:42.670 21:23:36 -- common/autotest_common.sh@99 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:22:42.670 21:23:36 -- common/autotest_common.sh@101 -- # : rdma 00:22:42.670 21:23:36 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:22:42.670 21:23:36 -- common/autotest_common.sh@103 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:22:42.670 21:23:36 -- common/autotest_common.sh@105 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:22:42.670 21:23:36 -- common/autotest_common.sh@107 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:22:42.670 21:23:36 -- common/autotest_common.sh@109 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:22:42.670 21:23:36 -- common/autotest_common.sh@111 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:22:42.670 21:23:36 -- common/autotest_common.sh@113 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:22:42.670 21:23:36 -- common/autotest_common.sh@115 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:22:42.670 21:23:36 -- common/autotest_common.sh@117 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:22:42.670 21:23:36 -- common/autotest_common.sh@119 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:22:42.670 21:23:36 -- common/autotest_common.sh@121 -- # : 1 00:22:42.670 21:23:36 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:22:42.670 21:23:36 -- common/autotest_common.sh@123 -- # : 00:22:42.670 21:23:36 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:22:42.670 21:23:36 -- common/autotest_common.sh@125 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:22:42.670 21:23:36 -- common/autotest_common.sh@127 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:22:42.670 21:23:36 -- common/autotest_common.sh@129 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:22:42.670 21:23:36 -- common/autotest_common.sh@131 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:22:42.670 21:23:36 -- common/autotest_common.sh@133 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:22:42.670 21:23:36 -- common/autotest_common.sh@135 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:22:42.670 21:23:36 -- common/autotest_common.sh@137 -- # : 00:22:42.670 21:23:36 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:22:42.670 21:23:36 -- common/autotest_common.sh@139 -- # : true 00:22:42.670 21:23:36 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:22:42.670 21:23:36 -- common/autotest_common.sh@141 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:22:42.670 21:23:36 -- common/autotest_common.sh@143 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:22:42.670 21:23:36 -- common/autotest_common.sh@145 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:22:42.670 21:23:36 -- common/autotest_common.sh@147 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:22:42.670 21:23:36 -- common/autotest_common.sh@149 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:22:42.670 21:23:36 -- common/autotest_common.sh@151 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:22:42.670 21:23:36 -- common/autotest_common.sh@153 -- # : mlx5 00:22:42.670 21:23:36 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:22:42.670 21:23:36 -- common/autotest_common.sh@155 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:22:42.670 21:23:36 -- common/autotest_common.sh@157 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:22:42.670 21:23:36 -- common/autotest_common.sh@159 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:22:42.670 21:23:36 -- common/autotest_common.sh@161 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:22:42.670 21:23:36 -- common/autotest_common.sh@163 -- # : 0 00:22:42.670 21:23:36 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:22:42.670 21:23:36 -- common/autotest_common.sh@166 -- # : 00:22:42.671 21:23:36 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:22:42.671 21:23:36 -- common/autotest_common.sh@168 -- # : 0 00:22:42.671 21:23:36 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:22:42.671 21:23:36 -- common/autotest_common.sh@170 -- # : 0 00:22:42.671 21:23:36 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:22:42.671 21:23:36 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:42.671 21:23:36 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:22:42.671 21:23:36 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:22:42.671 21:23:36 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:22:42.671 21:23:36 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:22:42.671 21:23:36 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:22:42.671 21:23:36 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:22:42.671 21:23:36 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:22:42.671 21:23:36 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:22:42.671 21:23:36 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:22:42.671 21:23:36 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:22:42.671 21:23:36 -- common/autotest_common.sh@199 -- # cat 00:22:42.671 21:23:36 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:22:42.671 21:23:36 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:22:42.671 21:23:36 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:22:42.671 21:23:36 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:22:42.671 21:23:36 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:22:42.671 21:23:36 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:22:42.671 21:23:36 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:22:42.671 21:23:36 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:22:42.671 21:23:36 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:22:42.671 21:23:36 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:22:42.671 21:23:36 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:22:42.671 21:23:36 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:22:42.671 21:23:36 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:22:42.671 21:23:36 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:22:42.671 21:23:36 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:22:42.671 21:23:36 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:22:42.671 21:23:36 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:22:42.671 21:23:36 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:22:42.671 21:23:36 -- common/autotest_common.sh@252 -- # export valgrind= 00:22:42.671 21:23:36 -- common/autotest_common.sh@252 -- # valgrind= 00:22:42.671 21:23:36 -- common/autotest_common.sh@258 -- # uname -s 00:22:42.671 21:23:36 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:22:42.671 21:23:36 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:22:42.671 21:23:36 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:22:42.671 21:23:36 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@268 -- # MAKE=make 00:22:42.671 21:23:36 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j112 00:22:42.671 21:23:36 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:22:42.671 21:23:36 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:22:42.671 21:23:36 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:22:42.671 21:23:36 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:22:42.671 21:23:36 -- common/autotest_common.sh@289 -- # for i in "$@" 00:22:42.671 21:23:36 -- common/autotest_common.sh@290 -- # case "$i" in 00:22:42.671 21:23:36 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:22:42.671 21:23:36 -- common/autotest_common.sh@307 -- # [[ -z 1415281 ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@307 -- # kill -0 1415281 00:22:42.671 21:23:36 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:22:42.671 21:23:36 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:22:42.671 21:23:36 -- common/autotest_common.sh@320 -- # local mount target_dir 00:22:42.671 21:23:36 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:22:42.671 21:23:36 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:22:42.671 21:23:36 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:22:42.671 21:23:36 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:22:42.671 21:23:36 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.CvH1Ey 00:22:42.671 21:23:36 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:22:42.671 21:23:36 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:22:42.671 21:23:36 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.CvH1Ey/tests/target /tmp/spdk.CvH1Ey 00:22:42.671 21:23:36 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:22:42.671 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.671 21:23:36 -- common/autotest_common.sh@316 -- # df -T 00:22:42.671 21:23:36 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:22:42.671 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:22:42.671 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=958902272 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:22:42.671 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=4325527552 00:22:42.671 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=89217929216 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95554760704 00:22:42.671 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=6336831488 00:22:42.671 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=47770374144 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777378304 00:22:42.671 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=7004160 00:22:42.671 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:42.671 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=19087839232 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19110952960 00:22:42.672 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=23113728 00:22:42.672 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=47776993280 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777382400 00:22:42.672 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=389120 00:22:42.672 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=9555468288 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9555472384 00:22:42.672 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:22:42.672 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=9555468288 00:22:42.672 21:23:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9555472384 00:22:42.672 21:23:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:22:42.672 21:23:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:42.672 21:23:36 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:22:42.672 * Looking for test storage... 00:22:42.672 21:23:36 -- common/autotest_common.sh@357 -- # local target_space new_size 00:22:42.672 21:23:36 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:22:42.672 21:23:36 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.672 21:23:36 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:22:42.672 21:23:36 -- common/autotest_common.sh@361 -- # mount=/ 00:22:42.672 21:23:36 -- common/autotest_common.sh@363 -- # target_space=89217929216 00:22:42.672 21:23:36 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:22:42.672 21:23:36 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:22:42.672 21:23:36 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:22:42.672 21:23:36 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:22:42.672 21:23:36 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:22:42.672 21:23:36 -- common/autotest_common.sh@370 -- # new_size=8551424000 00:22:42.672 21:23:36 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:22:42.672 21:23:36 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.672 21:23:36 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.672 21:23:36 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.672 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:42.672 21:23:36 -- common/autotest_common.sh@378 -- # return 0 00:22:42.672 21:23:36 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:22:42.672 21:23:36 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:22:42.672 21:23:36 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:22:42.672 21:23:36 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:22:42.672 21:23:36 -- common/autotest_common.sh@1673 -- # true 00:22:42.672 21:23:36 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:22:42.672 21:23:36 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:22:42.672 21:23:36 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:22:42.672 21:23:36 -- common/autotest_common.sh@27 -- # exec 00:22:42.672 21:23:36 -- common/autotest_common.sh@29 -- # exec 00:22:42.672 21:23:36 -- common/autotest_common.sh@31 -- # xtrace_restore 00:22:42.672 21:23:36 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:22:42.672 21:23:36 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:22:42.672 21:23:36 -- common/autotest_common.sh@18 -- # set -x 00:22:42.672 21:23:36 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:42.672 21:23:36 -- nvmf/common.sh@7 -- # uname -s 00:22:42.672 21:23:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:42.672 21:23:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:42.672 21:23:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:42.672 21:23:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:42.672 21:23:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:42.672 21:23:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:42.672 21:23:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:42.672 21:23:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:42.672 21:23:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:42.672 21:23:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:42.672 21:23:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:22:42.672 21:23:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:22:42.672 21:23:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:42.672 21:23:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:42.672 21:23:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:42.672 21:23:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:42.672 21:23:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:42.672 21:23:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:42.672 21:23:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:42.672 21:23:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:42.672 21:23:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.672 21:23:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.672 21:23:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.672 21:23:36 -- paths/export.sh@5 -- # export PATH 00:22:42.672 21:23:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:42.672 21:23:36 -- nvmf/common.sh@47 -- # : 0 00:22:42.672 21:23:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:42.672 21:23:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:42.672 21:23:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:42.672 21:23:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:42.672 21:23:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:42.672 21:23:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:42.672 21:23:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:42.672 21:23:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:42.672 21:23:36 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:22:42.672 21:23:36 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:22:42.672 21:23:36 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:42.673 21:23:36 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:22:42.673 21:23:36 -- target/device_removal.sh@18 -- # nvmftestinit 00:22:42.673 21:23:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:42.673 21:23:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:42.673 21:23:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:42.673 21:23:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:42.673 21:23:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:42.673 21:23:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:42.673 21:23:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:42.673 21:23:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:42.673 21:23:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:42.673 21:23:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:42.673 21:23:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:42.673 21:23:36 -- common/autotest_common.sh@10 -- # set +x 00:22:48.016 21:23:42 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:48.016 21:23:42 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:48.016 21:23:42 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:48.016 21:23:42 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:48.016 21:23:42 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:48.016 21:23:42 -- nvmf/common.sh@295 -- # net_devs=() 00:22:48.016 21:23:42 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@296 -- # e810=() 00:22:48.016 21:23:42 -- nvmf/common.sh@296 -- # local -ga e810 00:22:48.016 21:23:42 -- nvmf/common.sh@297 -- # x722=() 00:22:48.016 21:23:42 -- nvmf/common.sh@297 -- # local -ga x722 00:22:48.016 21:23:42 -- nvmf/common.sh@298 -- # mlx=() 00:22:48.016 21:23:42 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:48.016 21:23:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:48.016 21:23:42 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:48.016 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:48.016 21:23:42 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:48.016 21:23:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:48.016 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:48.016 21:23:42 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:48.016 21:23:42 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.016 21:23:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.016 21:23:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:48.016 Found net devices under 0000:18:00.0: mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.016 21:23:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.016 21:23:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:48.016 Found net devices under 0000:18:00.1: mlx_0_1 00:22:48.016 21:23:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.016 21:23:42 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:48.016 21:23:42 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:48.016 21:23:42 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:48.016 21:23:42 -- nvmf/common.sh@58 -- # uname 00:22:48.016 21:23:42 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:48.016 21:23:42 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:48.016 21:23:42 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:48.016 21:23:42 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:48.016 21:23:42 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:48.016 21:23:42 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:48.016 21:23:42 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:48.016 21:23:42 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:48.016 21:23:42 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:48.016 21:23:42 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:48.016 21:23:42 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:48.016 21:23:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:48.016 21:23:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:48.016 21:23:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@105 -- # continue 2 00:22:48.016 21:23:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:48.016 21:23:42 -- nvmf/common.sh@105 -- # continue 2 00:22:48.016 21:23:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:48.016 21:23:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:48.016 21:23:42 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:48.016 21:23:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:48.016 56: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:48.016 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:22:48.016 altname enp24s0f0np0 00:22:48.016 altname ens785f0np0 00:22:48.016 inet 192.168.100.8/24 scope global mlx_0_0 00:22:48.016 valid_lft forever preferred_lft forever 00:22:48.016 21:23:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:48.016 21:23:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:48.016 21:23:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:48.016 21:23:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:48.016 21:23:42 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:48.016 21:23:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:48.016 57: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:48.016 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:22:48.016 altname enp24s0f1np1 00:22:48.016 altname ens785f1np1 00:22:48.016 inet 192.168.100.9/24 scope global mlx_0_1 00:22:48.016 valid_lft forever preferred_lft forever 00:22:48.016 21:23:42 -- nvmf/common.sh@411 -- # return 0 00:22:48.016 21:23:42 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:48.016 21:23:42 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:48.016 21:23:42 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:48.016 21:23:42 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:48.016 21:23:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:48.016 21:23:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:48.016 21:23:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:48.016 21:23:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:48.016 21:23:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:48.016 21:23:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:48.016 21:23:42 -- nvmf/common.sh@105 -- # continue 2 00:22:48.016 21:23:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:48.016 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.017 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:48.017 21:23:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:48.017 21:23:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:48.017 21:23:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:48.017 21:23:42 -- nvmf/common.sh@105 -- # continue 2 00:22:48.017 21:23:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:48.017 21:23:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:48.017 21:23:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:48.017 21:23:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:48.017 21:23:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:48.017 21:23:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:48.017 21:23:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:48.017 21:23:42 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:48.017 192.168.100.9' 00:22:48.017 21:23:42 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:48.017 192.168.100.9' 00:22:48.017 21:23:42 -- nvmf/common.sh@446 -- # head -n 1 00:22:48.017 21:23:42 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:48.017 21:23:42 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:48.017 192.168.100.9' 00:22:48.017 21:23:42 -- nvmf/common.sh@447 -- # tail -n +2 00:22:48.017 21:23:42 -- nvmf/common.sh@447 -- # head -n 1 00:22:48.017 21:23:42 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:48.017 21:23:42 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:48.017 21:23:42 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:48.017 21:23:42 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:48.017 21:23:42 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:48.017 21:23:42 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:48.017 21:23:42 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:22:48.017 21:23:42 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:22:48.017 21:23:42 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:22:48.017 21:23:42 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:22:48.017 21:23:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:48.017 21:23:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:48.017 21:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:48.275 ************************************ 00:22:48.275 START TEST nvmf_device_removal_pci_remove_no_srq 00:22:48.275 ************************************ 00:22:48.275 21:23:42 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:22:48.275 21:23:42 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:22:48.275 21:23:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:48.275 21:23:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:48.275 21:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:48.275 21:23:42 -- nvmf/common.sh@470 -- # nvmfpid=1418522 00:22:48.275 21:23:42 -- nvmf/common.sh@471 -- # waitforlisten 1418522 00:22:48.275 21:23:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:22:48.275 21:23:42 -- common/autotest_common.sh@817 -- # '[' -z 1418522 ']' 00:22:48.275 21:23:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.275 21:23:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:48.275 21:23:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.275 21:23:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:48.275 21:23:42 -- common/autotest_common.sh@10 -- # set +x 00:22:48.275 [2024-04-23 21:23:42.441062] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:22:48.275 [2024-04-23 21:23:42.441102] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:48.275 EAL: No free 2048 kB hugepages reported on node 1 00:22:48.275 [2024-04-23 21:23:42.493370] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:22:48.533 [2024-04-23 21:23:42.563077] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:48.533 [2024-04-23 21:23:42.563114] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:48.533 [2024-04-23 21:23:42.563120] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:48.533 [2024-04-23 21:23:42.563125] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:48.533 [2024-04-23 21:23:42.563129] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:48.533 [2024-04-23 21:23:42.563168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.533 [2024-04-23 21:23:42.563172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:49.097 21:23:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:49.097 21:23:43 -- common/autotest_common.sh@850 -- # return 0 00:22:49.097 21:23:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:49.097 21:23:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:49.097 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.097 21:23:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:49.097 21:23:43 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:22:49.097 21:23:43 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:22:49.097 21:23:43 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:22:49.097 21:23:43 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:22:49.097 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.097 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.097 [2024-04-23 21:23:43.273292] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e8c050/0x1e90540) succeed. 00:22:49.097 [2024-04-23 21:23:43.281666] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e8d550/0x1ed1bd0) succeed. 00:22:49.097 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.097 21:23:43 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:22:49.097 21:23:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:49.097 21:23:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:49.097 21:23:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:49.097 21:23:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:49.097 21:23:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:49.097 21:23:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:49.097 21:23:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:49.097 21:23:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:49.097 21:23:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:49.097 21:23:43 -- nvmf/common.sh@105 -- # continue 2 00:22:49.097 21:23:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:49.097 21:23:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:49.097 21:23:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:49.097 21:23:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:49.097 21:23:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:49.097 21:23:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:49.097 21:23:43 -- nvmf/common.sh@105 -- # continue 2 00:22:49.097 21:23:43 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:49.097 21:23:43 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:49.097 21:23:43 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:22:49.097 21:23:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:49.097 21:23:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:49.097 21:23:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:49.097 21:23:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:49.097 21:23:43 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:22:49.097 21:23:43 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:22:49.097 21:23:43 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:49.097 21:23:43 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:49.097 21:23:43 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:22:49.097 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.097 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.356 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.356 21:23:43 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:22:49.356 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.356 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.356 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.356 21:23:43 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:22:49.356 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.356 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.356 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.356 21:23:43 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:22:49.356 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.356 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.356 [2024-04-23 21:23:43.405958] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:49.356 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.356 21:23:43 -- target/device_removal.sh@41 -- # return 0 00:22:49.356 21:23:43 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:22:49.356 21:23:43 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:49.356 21:23:43 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:49.356 21:23:43 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:22:49.356 21:23:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:49.356 21:23:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:49.356 21:23:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:49.356 21:23:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:49.356 21:23:43 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:22:49.356 21:23:43 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:22:49.356 21:23:43 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:49.356 21:23:43 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:49.356 21:23:43 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:22:49.356 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.356 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.356 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.356 21:23:43 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:22:49.356 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.357 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.357 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.357 21:23:43 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:22:49.357 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.357 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.357 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.357 21:23:43 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:22:49.357 21:23:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:49.357 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:49.357 [2024-04-23 21:23:43.483975] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:22:49.357 21:23:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:49.357 21:23:43 -- target/device_removal.sh@41 -- # return 0 00:22:49.357 21:23:43 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:22:49.357 21:23:43 -- target/device_removal.sh@53 -- # return 0 00:22:49.357 21:23:43 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:22:49.357 21:23:43 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:22:49.357 21:23:43 -- target/device_removal.sh@87 -- # local dev_names 00:22:49.357 21:23:43 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:22:49.357 21:23:43 -- target/device_removal.sh@91 -- # bdevperf_pid=1418821 00:22:49.357 21:23:43 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:49.357 21:23:43 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:22:49.357 21:23:43 -- target/device_removal.sh@94 -- # waitforlisten 1418821 /var/tmp/bdevperf.sock 00:22:49.357 21:23:43 -- common/autotest_common.sh@817 -- # '[' -z 1418821 ']' 00:22:49.357 21:23:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:49.357 21:23:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:49.357 21:23:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:49.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:49.357 21:23:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:49.357 21:23:43 -- common/autotest_common.sh@10 -- # set +x 00:22:50.289 21:23:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:50.289 21:23:44 -- common/autotest_common.sh@850 -- # return 0 00:22:50.289 21:23:44 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:22:50.289 21:23:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:50.289 21:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:50.289 21:23:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:50.289 21:23:44 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:50.289 21:23:44 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:22:50.289 21:23:44 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:22:50.289 21:23:44 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:22:50.289 21:23:44 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:22:50.289 21:23:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:50.289 21:23:44 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:22:50.289 21:23:44 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:22:50.289 21:23:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:50.289 21:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:50.289 Nvme_mlx_0_0n1 00:22:50.289 21:23:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:50.289 21:23:44 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:50.289 21:23:44 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:22:50.289 21:23:44 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:22:50.289 21:23:44 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:22:50.289 21:23:44 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:22:50.289 21:23:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:50.289 21:23:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:50.289 21:23:44 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:22:50.289 21:23:44 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:22:50.289 21:23:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:50.289 21:23:44 -- common/autotest_common.sh@10 -- # set +x 00:22:50.289 Nvme_mlx_0_1n1 00:22:50.289 21:23:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:50.289 21:23:44 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=1418908 00:22:50.289 21:23:44 -- target/device_removal.sh@112 -- # sleep 5 00:22:50.289 21:23:44 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:22:55.553 21:23:49 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:22:55.553 21:23:49 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:22:55.553 21:23:49 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:22:55.553 21:23:49 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:22:55.553 21:23:49 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:22:55.553 21:23:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:55.553 21:23:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:55.553 21:23:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:55.553 21:23:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:55.553 21:23:49 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:22:55.553 21:23:49 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:22:55.553 21:23:49 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:22:55.553 21:23:49 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:22:55.553 21:23:49 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:22:55.553 21:23:49 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:55.553 21:23:49 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:55.553 21:23:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:55.553 21:23:49 -- common/autotest_common.sh@10 -- # set +x 00:22:55.553 21:23:49 -- target/device_removal.sh@77 -- # grep mlx5_0 00:22:55.553 21:23:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:55.553 mlx5_0 00:22:55.553 21:23:49 -- target/device_removal.sh@78 -- # return 0 00:22:55.553 21:23:49 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@67 -- # echo 1 00:22:55.553 21:23:49 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:22:55.553 21:23:49 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:22:55.553 [2024-04-23 21:23:49.663968] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:22:55.553 [2024-04-23 21:23:49.664067] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:55.553 [2024-04-23 21:23:49.668587] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:22:55.553 [2024-04-23 21:23:49.668613] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 65 00:22:55.553 [2024-04-23 21:23:49.668619] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:22:55.553 [2024-04-23 21:23:49.668624] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668629] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668634] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668639] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668643] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668648] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668652] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668657] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668661] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668666] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668670] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668675] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668679] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668684] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668688] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668693] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668697] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668702] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668706] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668710] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668715] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668719] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668723] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668727] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668732] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668736] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668741] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668746] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668751] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668758] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668763] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668767] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668772] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668776] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668780] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668785] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668789] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668793] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668798] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668802] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668808] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668812] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668816] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668821] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668827] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668833] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668837] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668842] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668847] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668851] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668861] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668866] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668874] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668878] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668882] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668887] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668891] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668895] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668900] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668904] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668909] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668913] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.553 [2024-04-23 21:23:49.668917] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.553 [2024-04-23 21:23:49.668922] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668927] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668931] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668935] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668940] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668944] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668948] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668956] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668961] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668966] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668970] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668975] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668979] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668983] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668988] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.668992] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.668997] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669001] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669006] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669010] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669014] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669019] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669023] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669028] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669032] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669036] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669040] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669045] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669050] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669054] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669058] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669062] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669067] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669071] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669076] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669080] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669084] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669089] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669093] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669097] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669102] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669106] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669111] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669115] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669120] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669124] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669128] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669132] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669137] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669143] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669147] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669152] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669156] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669161] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669165] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669169] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669174] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669178] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669183] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669187] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669192] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669196] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669200] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669204] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:22:55.554 [2024-04-23 21:23:49.669209] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:22:55.554 [2024-04-23 21:23:49.669213] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:02.112 21:23:55 -- target/device_removal.sh@147 -- # seq 1 10 00:23:02.112 21:23:55 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:23:02.112 21:23:55 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:23:02.112 21:23:55 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:23:02.112 21:23:55 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:02.112 21:23:55 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:02.112 21:23:55 -- target/device_removal.sh@77 -- # grep mlx5_0 00:23:02.112 21:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:02.112 21:23:55 -- common/autotest_common.sh@10 -- # set +x 00:23:02.112 21:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:02.112 21:23:55 -- target/device_removal.sh@78 -- # return 1 00:23:02.112 21:23:55 -- target/device_removal.sh@149 -- # break 00:23:02.112 21:23:55 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:02.112 21:23:55 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:02.112 21:23:55 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:02.112 21:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:02.112 21:23:55 -- common/autotest_common.sh@10 -- # set +x 00:23:02.112 21:23:55 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:02.112 21:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:02.112 21:23:55 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:23:02.112 21:23:55 -- target/device_removal.sh@160 -- # rescan_pci 00:23:02.112 21:23:55 -- target/device_removal.sh@57 -- # echo 1 00:23:02.112 [2024-04-23 21:23:56.331494] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x20ca6b0, err 11. Skip rescan. 00:23:02.678 [2024-04-23 21:23:56.693331] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e8d150/0x1e90540) succeed. 00:23:02.678 [2024-04-23 21:23:56.693388] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:23:03.610 21:23:57 -- target/device_removal.sh@162 -- # seq 1 10 00:23:03.610 21:23:57 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:03.610 21:23:57 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:23:03.610 21:23:57 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:23:03.610 21:23:57 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:23:03.610 21:23:57 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:23:03.610 21:23:57 -- target/device_removal.sh@171 -- # break 00:23:03.610 21:23:57 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:23:03.610 21:23:57 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:23:05.513 21:23:59 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:23:05.513 21:23:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:05.513 21:23:59 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:05.513 21:23:59 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:23:05.513 21:23:59 -- target/device_removal.sh@186 -- # seq 1 10 00:23:05.513 21:23:59 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:05.513 21:23:59 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:05.513 21:23:59 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:05.513 21:23:59 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:05.513 21:23:59 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:05.513 21:23:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:05.513 21:23:59 -- common/autotest_common.sh@10 -- # set +x 00:23:05.513 [2024-04-23 21:23:59.692369] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:05.513 [2024-04-23 21:23:59.692400] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:23:05.513 [2024-04-23 21:23:59.692413] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:05.513 [2024-04-23 21:23:59.692423] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:05.513 21:23:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:05.513 21:23:59 -- target/device_removal.sh@187 -- # ib_count=2 00:23:05.513 21:23:59 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:05.513 21:23:59 -- target/device_removal.sh@189 -- # break 00:23:05.513 21:23:59 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:23:05.513 21:23:59 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:05.513 21:23:59 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:23:05.513 21:23:59 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:23:05.513 21:23:59 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:23:05.513 21:23:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:05.513 21:23:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:05.513 21:23:59 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:23:05.513 21:23:59 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:05.513 21:23:59 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:05.513 21:23:59 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:23:05.513 21:23:59 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:23:05.513 21:23:59 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:23:05.513 21:23:59 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:05.513 21:23:59 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:05.513 21:23:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:05.513 21:23:59 -- common/autotest_common.sh@10 -- # set +x 00:23:05.513 21:23:59 -- target/device_removal.sh@77 -- # grep mlx5_1 00:23:05.513 21:23:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:05.774 mlx5_1 00:23:05.774 21:23:59 -- target/device_removal.sh@78 -- # return 0 00:23:05.774 21:23:59 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:23:05.774 21:23:59 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:23:05.774 21:23:59 -- target/device_removal.sh@67 -- # echo 1 00:23:05.774 21:23:59 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:23:05.774 21:23:59 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:05.774 21:23:59 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:05.774 [2024-04-23 21:23:59.855599] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:23:05.774 [2024-04-23 21:23:59.855662] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:05.774 [2024-04-23 21:23:59.861660] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:05.774 [2024-04-23 21:23:59.861674] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 98 00:23:05.774 [2024-04-23 21:23:59.861680] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:23:05.774 [2024-04-23 21:23:59.861686] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861692] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861697] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861702] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861707] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861711] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861715] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861720] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861724] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861729] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861733] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861737] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861743] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861748] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861753] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861758] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861762] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861766] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861771] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861775] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861779] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861783] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861788] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861793] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861798] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861802] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861807] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861811] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861815] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861819] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861824] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861829] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861833] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861841] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861847] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861852] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861861] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861865] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861870] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861875] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861879] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861883] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861887] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861892] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861896] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861901] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861906] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861911] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861915] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.774 [2024-04-23 21:23:59.861919] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.774 [2024-04-23 21:23:59.861923] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.774 [2024-04-23 21:23:59.861927] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.774 [2024-04-23 21:23:59.861932] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861936] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.861940] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.861945] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861950] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861955] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861960] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861965] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861969] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861973] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861977] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861981] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861987] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.861991] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.861997] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862002] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862006] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862010] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862015] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862020] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862024] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862028] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862034] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862039] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862044] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862048] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862052] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862057] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862061] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862065] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862069] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862074] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862078] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862082] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862087] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862092] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862096] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862101] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862105] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862109] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862113] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862117] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862121] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862126] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862130] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862135] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862139] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862144] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862148] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862152] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862156] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862160] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862164] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862168] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862173] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862178] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862182] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862187] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862191] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862195] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862200] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862204] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862208] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862212] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862217] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862222] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862227] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862231] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862235] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862240] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862244] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862248] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862252] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862256] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862260] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862265] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862270] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862275] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862284] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862288] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862292] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862297] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862301] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862306] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862310] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862317] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862323] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862328] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862333] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862339] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862346] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862352] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862357] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862364] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862368] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862372] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862376] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862381] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862385] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862390] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862394] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862398] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862403] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862407] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862411] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862415] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862424] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862429] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.775 [2024-04-23 21:23:59.862433] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.775 [2024-04-23 21:23:59.862438] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862443] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862448] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862453] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862457] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.775 [2024-04-23 21:23:59.862461] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.775 [2024-04-23 21:23:59.862466] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862470] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862474] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.776 [2024-04-23 21:23:59.862479] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.776 [2024-04-23 21:23:59.862483] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862487] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862492] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862496] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862501] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.776 [2024-04-23 21:23:59.862506] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:05.776 [2024-04-23 21:23:59.862510] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862515] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862519] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862523] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862527] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862533] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862538] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862542] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862547] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862551] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862555] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862559] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862563] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862567] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862572] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:05.776 [2024-04-23 21:23:59.862577] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:05.776 [2024-04-23 21:23:59.862581] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:05.776 [2024-04-23 21:23:59.862586] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:12.351 21:24:05 -- target/device_removal.sh@147 -- # seq 1 10 00:23:12.351 21:24:05 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:23:12.351 21:24:05 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:23:12.351 21:24:05 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:23:12.351 21:24:05 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:12.351 21:24:05 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:12.351 21:24:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:12.351 21:24:05 -- target/device_removal.sh@77 -- # grep mlx5_1 00:23:12.351 21:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:12.351 21:24:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:12.351 21:24:05 -- target/device_removal.sh@78 -- # return 1 00:23:12.351 21:24:05 -- target/device_removal.sh@149 -- # break 00:23:12.351 21:24:05 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:12.351 21:24:05 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:12.351 21:24:05 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:12.351 21:24:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:12.351 21:24:05 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:12.351 21:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:12.351 21:24:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:12.351 21:24:05 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:23:12.351 21:24:05 -- target/device_removal.sh@160 -- # rescan_pci 00:23:12.351 21:24:05 -- target/device_removal.sh@57 -- # echo 1 00:23:13.286 [2024-04-23 21:24:07.434804] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1e8f030, err 11. Skip rescan. 00:23:13.545 [2024-04-23 21:24:07.759995] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2097190/0x1ed1bd0) succeed. 00:23:13.545 [2024-04-23 21:24:07.760060] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:23:14.480 21:24:08 -- target/device_removal.sh@162 -- # seq 1 10 00:23:14.739 21:24:08 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:14.739 21:24:08 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:23:14.739 21:24:08 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:23:14.739 21:24:08 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:23:14.739 21:24:08 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:23:14.739 21:24:08 -- target/device_removal.sh@171 -- # break 00:23:14.739 21:24:08 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:23:14.739 21:24:08 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:23:14.739 21:24:08 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:23:14.739 21:24:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:14.739 21:24:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:14.739 21:24:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:14.739 21:24:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:14.739 21:24:08 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:14.739 21:24:08 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:23:14.739 21:24:08 -- target/device_removal.sh@186 -- # seq 1 10 00:23:14.739 21:24:08 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:14.739 21:24:08 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:14.739 21:24:08 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:14.739 21:24:08 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:14.739 21:24:08 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:14.739 21:24:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:14.739 21:24:08 -- common/autotest_common.sh@10 -- # set +x 00:23:14.739 [2024-04-23 21:24:08.865784] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:14.739 [2024-04-23 21:24:08.865816] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:23:14.739 [2024-04-23 21:24:08.865828] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:14.739 [2024-04-23 21:24:08.865839] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:14.739 21:24:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:14.739 21:24:08 -- target/device_removal.sh@187 -- # ib_count=2 00:23:14.739 21:24:08 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:14.739 21:24:08 -- target/device_removal.sh@189 -- # break 00:23:14.740 21:24:08 -- target/device_removal.sh@200 -- # stop_bdevperf 00:23:14.740 21:24:08 -- target/device_removal.sh@116 -- # wait 1418908 00:24:22.444 0 00:24:22.444 21:25:14 -- target/device_removal.sh@118 -- # killprocess 1418821 00:24:22.444 21:25:14 -- common/autotest_common.sh@936 -- # '[' -z 1418821 ']' 00:24:22.444 21:25:14 -- common/autotest_common.sh@940 -- # kill -0 1418821 00:24:22.444 21:25:14 -- common/autotest_common.sh@941 -- # uname 00:24:22.444 21:25:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:22.444 21:25:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1418821 00:24:22.444 21:25:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:24:22.444 21:25:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:24:22.444 21:25:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1418821' 00:24:22.444 killing process with pid 1418821 00:24:22.444 21:25:14 -- common/autotest_common.sh@955 -- # kill 1418821 00:24:22.444 21:25:14 -- common/autotest_common.sh@960 -- # wait 1418821 00:24:22.444 21:25:15 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:24:22.444 21:25:15 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:22.444 [2024-04-23 21:23:43.536749] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:24:22.444 [2024-04-23 21:23:43.536791] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1418821 ] 00:24:22.444 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.444 [2024-04-23 21:23:43.582575] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:22.444 [2024-04-23 21:23:43.647468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:22.444 Running I/O for 90 seconds... 00:24:22.444 [2024-04-23 21:23:49.662734] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:22.444 [2024-04-23 21:23:49.662768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.444 [2024-04-23 21:23:49.662777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.444 [2024-04-23 21:23:49.662785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.444 [2024-04-23 21:23:49.662791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.444 [2024-04-23 21:23:49.662798] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.444 [2024-04-23 21:23:49.662803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.444 [2024-04-23 21:23:49.662810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.444 [2024-04-23 21:23:49.662816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.444 [2024-04-23 21:23:49.664726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.444 [2024-04-23 21:23:49.664760] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.444 [2024-04-23 21:23:49.664825] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:22.444 [2024-04-23 21:23:49.672729] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.682751] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.692779] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.702804] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.712964] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.723066] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.733471] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.743757] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.444 [2024-04-23 21:23:49.754055] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.764081] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.774229] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.784253] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.794283] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.804534] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.814779] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.824805] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.834968] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.845358] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.855844] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.866235] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.876573] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.886795] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.897029] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.907056] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.917082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.927186] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.937508] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.949001] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.959025] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.969370] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.979394] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.989652] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:49.999677] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.009702] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.019726] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.029751] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.039774] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.049801] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.059828] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.069941] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.079968] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.090098] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.100696] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.111127] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.121469] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.131907] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.141933] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.151959] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.161984] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.172167] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.182495] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.193934] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.204044] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.214590] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.224609] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.234842] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.244867] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.255095] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.265291] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.276048] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.286431] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.296841] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.307094] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.317252] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.327434] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.337459] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.347483] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.357767] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.368488] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.378809] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.389960] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.399986] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.410069] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.420349] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.430372] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.440736] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.451436] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.461908] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.472383] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.482578] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.492605] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.502873] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.513184] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.523211] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.533236] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.543262] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.553768] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.564070] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.574554] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.584857] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.594884] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.605172] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.615197] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.625352] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.635377] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.645831] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.656539] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.667019] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.445 [2024-04-23 21:23:50.667245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:239112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:239120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:239128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:239136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:239144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:239152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:239160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:239168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:239176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:239184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:239192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:239200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:239208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:239216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:239224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:239232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:239240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:239248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:239256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:239264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:239272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:239280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:239288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:239296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:239304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:239312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:239320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:239328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:239336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:239344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:239352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:239360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:239368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:239376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:239384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x180700 00:24:22.446 [2024-04-23 21:23:50.667845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.446 [2024-04-23 21:23:50.667860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:239392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:239400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:239408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:239416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:239424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:239432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:239440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:239448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.667992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:239456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.667997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:239464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:239472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:239480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:239488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:239496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:239504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:239512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:239520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:239528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:239536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:239544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:239552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:239560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:239568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:239576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:239584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:239592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:239600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:239608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x180700 00:24:22.447 [2024-04-23 21:23:50.668322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.668333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:239616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.447 [2024-04-23 21:23:50.668339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.680065] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:22.447 [2024-04-23 21:23:50.680076] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:22.447 [2024-04-23 21:23:50.680083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:239624 len:8 PRP1 0x0 PRP2 0x0 00:24:22.447 [2024-04-23 21:23:50.680089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.680098] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:22.447 [2024-04-23 21:23:50.680102] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:22.447 [2024-04-23 21:23:50.680108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:239632 len:8 PRP1 0x0 PRP2 0x0 00:24:22.447 [2024-04-23 21:23:50.680113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:22.447 [2024-04-23 21:23:50.682088] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.447 [2024-04-23 21:23:50.682356] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.447 [2024-04-23 21:23:50.682370] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.447 [2024-04-23 21:23:50.682375] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.447 [2024-04-23 21:23:50.682393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.447 [2024-04-23 21:23:50.682400] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.447 [2024-04-23 21:23:50.682410] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.447 [2024-04-23 21:23:50.682416] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.447 [2024-04-23 21:23:50.682423] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.447 [2024-04-23 21:23:50.682439] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:50.682446] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:51.685120] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.448 [2024-04-23 21:23:51.685151] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.448 [2024-04-23 21:23:51.685158] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.448 [2024-04-23 21:23:51.685174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:51.685181] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.448 [2024-04-23 21:23:51.685191] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.448 [2024-04-23 21:23:51.685197] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.448 [2024-04-23 21:23:51.685203] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.448 [2024-04-23 21:23:51.685221] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:51.685228] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:52.687860] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.448 [2024-04-23 21:23:52.687889] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.448 [2024-04-23 21:23:52.687895] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.448 [2024-04-23 21:23:52.687911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:52.687918] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.448 [2024-04-23 21:23:52.687928] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.448 [2024-04-23 21:23:52.687934] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.448 [2024-04-23 21:23:52.687941] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.448 [2024-04-23 21:23:52.687963] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:52.687971] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:54.693104] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.448 [2024-04-23 21:23:54.693134] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.448 [2024-04-23 21:23:54.693159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:54.693167] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.448 [2024-04-23 21:23:54.693177] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.448 [2024-04-23 21:23:54.693183] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.448 [2024-04-23 21:23:54.693190] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.448 [2024-04-23 21:23:54.693209] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:54.693217] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:56.698038] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.448 [2024-04-23 21:23:56.698062] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.448 [2024-04-23 21:23:56.698082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:56.698090] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.448 [2024-04-23 21:23:56.698100] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.448 [2024-04-23 21:23:56.698106] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.448 [2024-04-23 21:23:56.698113] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.448 [2024-04-23 21:23:56.698133] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:56.698140] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:58.702964] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.448 [2024-04-23 21:23:58.702989] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:22.448 [2024-04-23 21:23:58.703008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:58.703015] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:22.448 [2024-04-23 21:23:58.703025] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:22.448 [2024-04-23 21:23:58.703031] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:22.448 [2024-04-23 21:23:58.703037] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:22.448 [2024-04-23 21:23:58.703053] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.448 [2024-04-23 21:23:58.703060] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:22.448 [2024-04-23 21:23:59.759639] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:22.448 [2024-04-23 21:23:59.859022] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:22.448 [2024-04-23 21:23:59.859046] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.448 [2024-04-23 21:23:59.859055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.448 [2024-04-23 21:23:59.859063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.448 [2024-04-23 21:23:59.859072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.448 [2024-04-23 21:23:59.859079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.448 [2024-04-23 21:23:59.859085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.448 [2024-04-23 21:23:59.859091] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:22.448 [2024-04-23 21:23:59.859096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32704 cdw0:16 sqhd:c3b9 p:0 m:0 dnr:0 00:24:22.448 [2024-04-23 21:23:59.860940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.448 [2024-04-23 21:23:59.860952] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.448 [2024-04-23 21:23:59.860976] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:22.448 [2024-04-23 21:23:59.869033] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.879057] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.889082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.899107] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.909132] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.919157] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.929183] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.939210] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.949237] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.959262] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.969287] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.979312] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.989336] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:23:59.999362] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.009389] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.019416] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.029440] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.039467] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.049493] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.059517] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.069542] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.079568] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.089594] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.099620] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.109645] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.119669] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.129693] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.448 [2024-04-23 21:24:00.139718] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.149743] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.159769] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.169795] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.179821] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.189846] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.199873] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.209897] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.219922] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.229948] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.239973] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.249997] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.260021] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.270048] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.280074] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.290099] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.300125] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.310150] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.320175] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.330201] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.340227] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.350254] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.360282] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.370307] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.380333] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.390359] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.400386] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.410412] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.420438] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.430464] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.440490] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.450516] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.460542] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.470568] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.480593] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.490618] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.500645] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.510669] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.520696] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.530723] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.540748] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.550774] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.560799] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.570826] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.580852] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.590879] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.600904] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.610929] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.620954] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.630979] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.641004] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.651029] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.661056] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.671081] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.681107] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.691131] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.701156] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.711268] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.721909] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.731928] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.742321] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.752962] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.763181] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.773206] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.785626] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.795653] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.805678] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.816838] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.826862] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.837235] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.849739] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.860060] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:22.449 [2024-04-23 21:24:00.863383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:134656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:134664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:134672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:134680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:134688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:134696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:134704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:134712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:134720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:134728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:134736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:134744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:134752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:134760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:134768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:134776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:134784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:134792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:134800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:134808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:134816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:134824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:134832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:134840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:134848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:134856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:134864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:134872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:134880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:134888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:134896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:134904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:134912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:134920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:134928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:134936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1bf800 00:24:22.450 [2024-04-23 21:24:00.863894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.450 [2024-04-23 21:24:00.863902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:134944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:134952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:134960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:134968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:134976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:134984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:134992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.863991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.863998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:135000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:135008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:135016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:135024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:135032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:135040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:135048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:135056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:135064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:135072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:135080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:135088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:135096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:135104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:135112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:135120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:135128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:135136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:135144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:135152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:135160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bf800 00:24:22.451 [2024-04-23 21:24:00.864285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:135168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:135176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:135184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:135192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:135200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:135208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:135216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:135224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.451 [2024-04-23 21:24:00.864400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:135232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.451 [2024-04-23 21:24:00.864406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:135240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:135248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:135256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:135264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:135272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:135280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:135288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:135296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:135304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:135312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:135320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:135328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:135336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:135344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:135352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:135360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:135368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:135376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:135384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:135392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:135400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:135408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:135416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:135424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:135432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:135440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:135448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:135456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:135464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:135472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:135480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:135488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:135496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:135504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:135512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:135520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:135528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:135536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.452 [2024-04-23 21:24:00.864911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:135544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.452 [2024-04-23 21:24:00.864917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:135552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.864930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:135560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.864942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:135568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.864959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:135576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.864972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:135584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.864987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.864995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:135592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:135600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:135608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:135616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:135624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:135632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:135640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:135648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:135656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.865113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:135664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:22.453 [2024-04-23 21:24:00.865119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32704 cdw0:8b593350 sqhd:9530 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.876863] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:22.453 [2024-04-23 21:24:00.876875] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:22.453 [2024-04-23 21:24:00.876882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:135672 len:8 PRP1 0x0 PRP2 0x0 00:24:22.453 [2024-04-23 21:24:00.876889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:22.453 [2024-04-23 21:24:00.876932] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.453 [2024-04-23 21:24:00.879260] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.453 [2024-04-23 21:24:00.879284] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.453 [2024-04-23 21:24:00.879290] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.453 [2024-04-23 21:24:00.879304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.453 [2024-04-23 21:24:00.879312] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.453 [2024-04-23 21:24:00.879333] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.453 [2024-04-23 21:24:00.879339] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.453 [2024-04-23 21:24:00.879346] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.453 [2024-04-23 21:24:00.879366] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.453 [2024-04-23 21:24:00.879374] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.453 [2024-04-23 21:24:01.882007] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.453 [2024-04-23 21:24:01.882041] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.453 [2024-04-23 21:24:01.882047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.453 [2024-04-23 21:24:01.882063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.453 [2024-04-23 21:24:01.882071] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.453 [2024-04-23 21:24:01.882081] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.453 [2024-04-23 21:24:01.882087] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.453 [2024-04-23 21:24:01.882094] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.453 [2024-04-23 21:24:01.882111] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.453 [2024-04-23 21:24:01.882118] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.453 [2024-04-23 21:24:02.885808] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:22.453 [2024-04-23 21:24:02.885841] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.453 [2024-04-23 21:24:02.885847] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.453 [2024-04-23 21:24:02.885864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.453 [2024-04-23 21:24:02.885872] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.453 [2024-04-23 21:24:02.885895] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.453 [2024-04-23 21:24:02.885901] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.453 [2024-04-23 21:24:02.885908] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.453 [2024-04-23 21:24:02.885927] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.453 [2024-04-23 21:24:02.885935] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.453 [2024-04-23 21:24:04.891530] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.453 [2024-04-23 21:24:04.891564] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.453 [2024-04-23 21:24:04.891586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.453 [2024-04-23 21:24:04.891594] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.453 [2024-04-23 21:24:04.891604] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.454 [2024-04-23 21:24:04.891611] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.454 [2024-04-23 21:24:04.891619] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.454 [2024-04-23 21:24:04.891643] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.454 [2024-04-23 21:24:04.891650] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.454 [2024-04-23 21:24:06.898048] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.454 [2024-04-23 21:24:06.898076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.454 [2024-04-23 21:24:06.898099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.454 [2024-04-23 21:24:06.898107] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.454 [2024-04-23 21:24:06.898118] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.454 [2024-04-23 21:24:06.898124] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.454 [2024-04-23 21:24:06.898133] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.454 [2024-04-23 21:24:06.898158] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.454 [2024-04-23 21:24:06.898166] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.454 [2024-04-23 21:24:08.905559] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:22.454 [2024-04-23 21:24:08.905584] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:22.454 [2024-04-23 21:24:08.905607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:22.454 [2024-04-23 21:24:08.905615] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:22.454 [2024-04-23 21:24:08.906471] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:22.454 [2024-04-23 21:24:08.906482] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:22.454 [2024-04-23 21:24:08.906490] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:22.454 [2024-04-23 21:24:08.906522] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:22.454 [2024-04-23 21:24:08.906531] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:22.454 [2024-04-23 21:24:10.032472] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:22.454 00:24:22.454 Latency(us) 00:24:22.454 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:22.454 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:22.454 Verification LBA range: start 0x0 length 0x8000 00:24:22.454 Nvme_mlx_0_0n1 : 90.01 11946.48 46.67 0.00 0.00 10694.79 1820.44 11035679.86 00:24:22.454 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:22.454 Verification LBA range: start 0x0 length 0x8000 00:24:22.454 Nvme_mlx_0_1n1 : 90.01 10587.91 41.36 0.00 0.00 12070.47 2160.26 11085390.13 00:24:22.454 =================================================================================================================== 00:24:22.454 Total : 22534.39 88.02 0.00 0.00 11341.16 1820.44 11085390.13 00:24:22.454 Received shutdown signal, test time was about 90.000000 seconds 00:24:22.454 00:24:22.454 Latency(us) 00:24:22.454 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:22.454 =================================================================================================================== 00:24:22.454 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:22.454 21:25:15 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:24:22.454 21:25:15 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:22.454 21:25:15 -- target/device_removal.sh@202 -- # killprocess 1418522 00:24:22.454 21:25:15 -- common/autotest_common.sh@936 -- # '[' -z 1418522 ']' 00:24:22.454 21:25:15 -- common/autotest_common.sh@940 -- # kill -0 1418522 00:24:22.454 21:25:15 -- common/autotest_common.sh@941 -- # uname 00:24:22.454 21:25:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:22.454 21:25:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1418522 00:24:22.454 21:25:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:22.454 21:25:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:22.454 21:25:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1418522' 00:24:22.454 killing process with pid 1418522 00:24:22.454 21:25:15 -- common/autotest_common.sh@955 -- # kill 1418522 00:24:22.454 21:25:15 -- common/autotest_common.sh@960 -- # wait 1418522 00:24:22.454 [2024-04-23 21:25:15.206654] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:22.454 21:25:15 -- target/device_removal.sh@203 -- # nvmfpid= 00:24:22.454 21:25:15 -- target/device_removal.sh@205 -- # return 0 00:24:22.454 00:24:22.454 real 1m33.085s 00:24:22.454 user 4m27.507s 00:24:22.454 sys 0m5.479s 00:24:22.454 21:25:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:22.454 21:25:15 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 ************************************ 00:24:22.454 END TEST nvmf_device_removal_pci_remove_no_srq 00:24:22.454 ************************************ 00:24:22.454 21:25:15 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:24:22.454 21:25:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:22.454 21:25:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:22.454 21:25:15 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 ************************************ 00:24:22.454 START TEST nvmf_device_removal_pci_remove 00:24:22.454 ************************************ 00:24:22.454 21:25:15 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:24:22.454 21:25:15 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:24:22.454 21:25:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:22.454 21:25:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:22.454 21:25:15 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 21:25:15 -- nvmf/common.sh@470 -- # nvmfpid=1436795 00:24:22.454 21:25:15 -- nvmf/common.sh@471 -- # waitforlisten 1436795 00:24:22.454 21:25:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:24:22.454 21:25:15 -- common/autotest_common.sh@817 -- # '[' -z 1436795 ']' 00:24:22.454 21:25:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:22.454 21:25:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:22.454 21:25:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:22.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:22.454 21:25:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:22.454 21:25:15 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 [2024-04-23 21:25:15.683845] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:24:22.454 [2024-04-23 21:25:15.683881] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:22.454 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.454 [2024-04-23 21:25:15.733651] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:24:22.454 [2024-04-23 21:25:15.802711] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:22.454 [2024-04-23 21:25:15.802749] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:22.454 [2024-04-23 21:25:15.802756] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:22.454 [2024-04-23 21:25:15.802762] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:22.454 [2024-04-23 21:25:15.802766] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:22.454 [2024-04-23 21:25:15.802816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:22.454 [2024-04-23 21:25:15.802819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:22.454 21:25:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:22.454 21:25:16 -- common/autotest_common.sh@850 -- # return 0 00:24:22.454 21:25:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:22.454 21:25:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:22.454 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 21:25:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:22.454 21:25:16 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:24:22.454 21:25:16 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:24:22.454 21:25:16 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:24:22.454 21:25:16 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:22.454 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.454 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.454 [2024-04-23 21:25:16.504346] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x155c050/0x1560540) succeed. 00:24:22.454 [2024-04-23 21:25:16.512322] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x155d550/0x15a1bd0) succeed. 00:24:22.454 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.454 21:25:16 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:24:22.454 21:25:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:22.454 21:25:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:22.454 21:25:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:22.454 21:25:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:22.454 21:25:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:22.454 21:25:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:22.454 21:25:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:22.454 21:25:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:22.454 21:25:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:22.454 21:25:16 -- nvmf/common.sh@105 -- # continue 2 00:24:22.454 21:25:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:22.454 21:25:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:22.454 21:25:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:22.454 21:25:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:22.454 21:25:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:22.454 21:25:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:22.455 21:25:16 -- nvmf/common.sh@105 -- # continue 2 00:24:22.455 21:25:16 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:22.455 21:25:16 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:22.455 21:25:16 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:24:22.455 21:25:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:22.455 21:25:16 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:24:22.455 21:25:16 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:22.455 21:25:16 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:22.455 21:25:16 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:24:22.455 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.455 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.455 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.455 21:25:16 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:24:22.455 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.455 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.455 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.455 21:25:16 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:24:22.455 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.455 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.455 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.455 21:25:16 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:24:22.455 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.455 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.455 [2024-04-23 21:25:16.689652] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:22.455 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.455 21:25:16 -- target/device_removal.sh@41 -- # return 0 00:24:22.455 21:25:16 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:24:22.455 21:25:16 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:22.455 21:25:16 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:22.455 21:25:16 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:24:22.455 21:25:16 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:24:22.455 21:25:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:22.455 21:25:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:22.714 21:25:16 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:24:22.714 21:25:16 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:24:22.714 21:25:16 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:22.714 21:25:16 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:22.714 21:25:16 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:24:22.714 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.714 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.714 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.714 21:25:16 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:24:22.714 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.714 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.714 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.714 21:25:16 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:24:22.714 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.714 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.714 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.714 21:25:16 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:24:22.714 21:25:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:22.714 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:22.714 [2024-04-23 21:25:16.768137] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:22.714 21:25:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:22.714 21:25:16 -- target/device_removal.sh@41 -- # return 0 00:24:22.715 21:25:16 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:24:22.715 21:25:16 -- target/device_removal.sh@53 -- # return 0 00:24:22.715 21:25:16 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:24:22.715 21:25:16 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:24:22.715 21:25:16 -- target/device_removal.sh@87 -- # local dev_names 00:24:22.715 21:25:16 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:24:22.715 21:25:16 -- target/device_removal.sh@91 -- # bdevperf_pid=1436956 00:24:22.715 21:25:16 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:22.715 21:25:16 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:24:22.715 21:25:16 -- target/device_removal.sh@94 -- # waitforlisten 1436956 /var/tmp/bdevperf.sock 00:24:22.715 21:25:16 -- common/autotest_common.sh@817 -- # '[' -z 1436956 ']' 00:24:22.715 21:25:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:22.715 21:25:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:22.715 21:25:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:22.715 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:22.715 21:25:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:22.715 21:25:16 -- common/autotest_common.sh@10 -- # set +x 00:24:23.708 21:25:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:23.708 21:25:17 -- common/autotest_common.sh@850 -- # return 0 00:24:23.708 21:25:17 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:24:23.708 21:25:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:23.708 21:25:17 -- common/autotest_common.sh@10 -- # set +x 00:24:23.708 21:25:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:23.708 21:25:17 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:23.708 21:25:17 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:24:23.708 21:25:17 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:24:23.708 21:25:17 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:24:23.708 21:25:17 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:24:23.708 21:25:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:23.708 21:25:17 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:24:23.708 21:25:17 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:24:23.708 21:25:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:23.708 21:25:17 -- common/autotest_common.sh@10 -- # set +x 00:24:23.708 Nvme_mlx_0_0n1 00:24:23.708 21:25:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:23.708 21:25:17 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:23.708 21:25:17 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:24:23.708 21:25:17 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:24:23.708 21:25:17 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:24:23.708 21:25:17 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:24:23.708 21:25:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:23.708 21:25:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:23.708 21:25:17 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:24:23.708 21:25:17 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:24:23.708 21:25:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:23.708 21:25:17 -- common/autotest_common.sh@10 -- # set +x 00:24:23.708 Nvme_mlx_0_1n1 00:24:23.708 21:25:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:23.708 21:25:17 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=1437183 00:24:23.708 21:25:17 -- target/device_removal.sh@112 -- # sleep 5 00:24:23.708 21:25:17 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:24:28.983 21:25:22 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:28.983 21:25:22 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:24:28.983 21:25:22 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:24:28.983 21:25:22 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:24:28.983 21:25:22 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:24:28.983 21:25:22 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:28.983 21:25:22 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:28.984 21:25:22 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:24:28.984 21:25:22 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:24:28.984 21:25:22 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:24:28.984 21:25:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:28.984 21:25:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:28.984 21:25:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:28.984 21:25:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:28.984 21:25:22 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:24:28.984 21:25:22 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:28.984 21:25:22 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:24:28.984 21:25:22 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:24:28.984 21:25:22 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:24:28.984 21:25:22 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:28.984 21:25:22 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:28.984 21:25:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:28.984 21:25:22 -- target/device_removal.sh@77 -- # grep mlx5_0 00:24:28.984 21:25:22 -- common/autotest_common.sh@10 -- # set +x 00:24:28.984 21:25:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:28.984 mlx5_0 00:24:28.984 21:25:22 -- target/device_removal.sh@78 -- # return 0 00:24:28.984 21:25:22 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@67 -- # echo 1 00:24:28.984 21:25:22 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:28.984 21:25:22 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:28.984 [2024-04-23 21:25:22.966381] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:24:28.984 [2024-04-23 21:25:22.966454] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:28.984 [2024-04-23 21:25:22.966957] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:28.984 [2024-04-23 21:25:22.966975] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 28 00:24:35.552 21:25:28 -- target/device_removal.sh@147 -- # seq 1 10 00:24:35.553 21:25:28 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:24:35.553 21:25:28 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:24:35.553 21:25:28 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:24:35.553 21:25:28 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:35.553 21:25:28 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:35.553 21:25:28 -- target/device_removal.sh@77 -- # grep mlx5_0 00:24:35.553 21:25:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:35.553 21:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:35.553 21:25:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:35.553 21:25:28 -- target/device_removal.sh@78 -- # return 1 00:24:35.553 21:25:28 -- target/device_removal.sh@149 -- # break 00:24:35.553 21:25:28 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:35.553 21:25:28 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:35.553 21:25:28 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:35.553 21:25:28 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:35.553 21:25:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:35.553 21:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:35.553 21:25:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:35.553 21:25:28 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:24:35.553 21:25:28 -- target/device_removal.sh@160 -- # rescan_pci 00:24:35.553 21:25:28 -- target/device_removal.sh@57 -- # echo 1 00:24:35.553 [2024-04-23 21:25:29.523762] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1639410, err 11. Skip rescan. 00:24:35.811 [2024-04-23 21:25:29.908352] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1628ee0/0x1560540) succeed. 00:24:35.812 [2024-04-23 21:25:29.908409] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:24:36.746 21:25:30 -- target/device_removal.sh@162 -- # seq 1 10 00:24:36.746 21:25:30 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:24:36.746 21:25:30 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:24:36.746 21:25:30 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:24:36.746 21:25:30 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:24:36.746 21:25:30 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:24:36.746 21:25:30 -- target/device_removal.sh@171 -- # break 00:24:36.746 21:25:30 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:24:36.746 21:25:30 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:24:38.647 21:25:32 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:24:38.647 21:25:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:38.647 21:25:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:38.647 21:25:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.647 21:25:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.647 21:25:32 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:24:38.647 21:25:32 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:24:38.647 21:25:32 -- target/device_removal.sh@186 -- # seq 1 10 00:24:38.647 21:25:32 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:24:38.647 21:25:32 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:38.647 21:25:32 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:38.647 21:25:32 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:38.647 21:25:32 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:38.647 21:25:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.647 21:25:32 -- common/autotest_common.sh@10 -- # set +x 00:24:38.647 [2024-04-23 21:25:32.889877] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:38.647 [2024-04-23 21:25:32.889910] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:24:38.647 [2024-04-23 21:25:32.889923] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:38.647 [2024-04-23 21:25:32.889934] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:38.647 21:25:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.905 21:25:32 -- target/device_removal.sh@187 -- # ib_count=2 00:24:38.905 21:25:32 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:24:38.905 21:25:32 -- target/device_removal.sh@189 -- # break 00:24:38.905 21:25:32 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:38.905 21:25:32 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:38.905 21:25:32 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:24:38.905 21:25:32 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:24:38.905 21:25:32 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:24:38.905 21:25:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:38.905 21:25:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:38.905 21:25:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.905 21:25:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.905 21:25:32 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:24:38.905 21:25:32 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:38.905 21:25:32 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:38.905 21:25:32 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:24:38.905 21:25:32 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:24:38.905 21:25:32 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:24:38.905 21:25:32 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:38.905 21:25:32 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:38.905 21:25:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.905 21:25:32 -- target/device_removal.sh@77 -- # grep mlx5_1 00:24:38.905 21:25:32 -- common/autotest_common.sh@10 -- # set +x 00:24:38.905 21:25:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.905 mlx5_1 00:24:38.905 21:25:33 -- target/device_removal.sh@78 -- # return 0 00:24:38.905 21:25:33 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:24:38.905 21:25:33 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:24:38.905 21:25:33 -- target/device_removal.sh@67 -- # echo 1 00:24:38.905 21:25:33 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:24:38.905 21:25:33 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:38.905 21:25:33 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:38.905 [2024-04-23 21:25:33.055187] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:24:38.905 [2024-04-23 21:25:33.055253] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:38.905 [2024-04-23 21:25:33.064060] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:38.905 [2024-04-23 21:25:33.064076] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 39 00:24:45.468 21:25:38 -- target/device_removal.sh@147 -- # seq 1 10 00:24:45.468 21:25:38 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:24:45.468 21:25:38 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:24:45.468 21:25:38 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:24:45.468 21:25:38 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:45.468 21:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:45.468 21:25:38 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:45.468 21:25:38 -- target/device_removal.sh@77 -- # grep mlx5_1 00:24:45.468 21:25:38 -- common/autotest_common.sh@10 -- # set +x 00:24:45.468 21:25:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:45.468 21:25:38 -- target/device_removal.sh@78 -- # return 1 00:24:45.468 21:25:38 -- target/device_removal.sh@149 -- # break 00:24:45.468 21:25:38 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:45.468 21:25:38 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:45.468 21:25:38 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:45.468 21:25:38 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:45.468 21:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:45.468 21:25:38 -- common/autotest_common.sh@10 -- # set +x 00:24:45.468 21:25:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:45.468 21:25:38 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:24:45.468 21:25:38 -- target/device_removal.sh@160 -- # rescan_pci 00:24:45.468 21:25:38 -- target/device_removal.sh@57 -- # echo 1 00:24:46.404 [2024-04-23 21:25:40.545704] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1549460, err 11. Skip rescan. 00:24:46.663 [2024-04-23 21:25:40.898096] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x155f360/0x15a1bd0) succeed. 00:24:46.663 [2024-04-23 21:25:40.898173] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:24:47.600 21:25:41 -- target/device_removal.sh@162 -- # seq 1 10 00:24:47.600 21:25:41 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:24:47.600 21:25:41 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:24:47.600 21:25:41 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:24:47.600 21:25:41 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:24:47.600 21:25:41 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:24:47.600 21:25:41 -- target/device_removal.sh@171 -- # break 00:24:47.600 21:25:41 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:24:47.600 21:25:41 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:24:47.600 21:25:41 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:24:47.600 21:25:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:47.600 21:25:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:47.600 21:25:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:47.600 21:25:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:47.600 21:25:41 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:24:47.600 21:25:41 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:24:47.600 21:25:41 -- target/device_removal.sh@186 -- # seq 1 10 00:24:47.600 21:25:41 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:24:47.859 21:25:41 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:47.859 21:25:41 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:47.859 21:25:41 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:47.859 21:25:41 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:47.859 21:25:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:47.859 21:25:41 -- common/autotest_common.sh@10 -- # set +x 00:24:47.859 [2024-04-23 21:25:41.906960] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:47.859 [2024-04-23 21:25:41.906994] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:24:47.859 [2024-04-23 21:25:41.907007] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:47.859 [2024-04-23 21:25:41.907019] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:47.860 21:25:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:47.860 21:25:41 -- target/device_removal.sh@187 -- # ib_count=2 00:24:47.860 21:25:41 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:24:47.860 21:25:41 -- target/device_removal.sh@189 -- # break 00:24:47.860 21:25:41 -- target/device_removal.sh@200 -- # stop_bdevperf 00:24:47.860 21:25:41 -- target/device_removal.sh@116 -- # wait 1437183 00:25:55.586 0 00:25:55.586 21:26:48 -- target/device_removal.sh@118 -- # killprocess 1436956 00:25:55.586 21:26:48 -- common/autotest_common.sh@936 -- # '[' -z 1436956 ']' 00:25:55.586 21:26:48 -- common/autotest_common.sh@940 -- # kill -0 1436956 00:25:55.586 21:26:48 -- common/autotest_common.sh@941 -- # uname 00:25:55.586 21:26:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.586 21:26:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1436956 00:25:55.586 21:26:48 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:25:55.586 21:26:48 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:25:55.586 21:26:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1436956' 00:25:55.586 killing process with pid 1436956 00:25:55.586 21:26:48 -- common/autotest_common.sh@955 -- # kill 1436956 00:25:55.586 21:26:48 -- common/autotest_common.sh@960 -- # wait 1436956 00:25:55.586 21:26:48 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:25:55.586 21:26:48 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:25:55.586 [2024-04-23 21:25:16.820780] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:25:55.586 [2024-04-23 21:25:16.820821] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1436956 ] 00:25:55.586 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.586 [2024-04-23 21:25:16.867477] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.586 [2024-04-23 21:25:16.937918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:55.586 Running I/O for 90 seconds... 00:25:55.586 [2024-04-23 21:25:22.961593] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:55.586 [2024-04-23 21:25:22.961628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.586 [2024-04-23 21:25:22.961637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.586 [2024-04-23 21:25:22.961644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.586 [2024-04-23 21:25:22.961650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.586 [2024-04-23 21:25:22.961657] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.586 [2024-04-23 21:25:22.961663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.586 [2024-04-23 21:25:22.961669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.586 [2024-04-23 21:25:22.961674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.586 [2024-04-23 21:25:22.963530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.586 [2024-04-23 21:25:22.963544] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.586 [2024-04-23 21:25:22.963563] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:55.586 [2024-04-23 21:25:22.971592] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:22.981614] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:22.991636] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.001665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.011690] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.021867] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.031893] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.041917] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.052363] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.062387] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.073038] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.083502] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.093820] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.104136] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.114232] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.124257] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.134287] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.144417] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.154442] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.164467] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.174730] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.185374] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.195886] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.206140] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.216400] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.226623] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.236648] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.246925] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.256951] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.266978] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.277540] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.288255] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.298617] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.308942] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.319221] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.329443] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.339468] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.349759] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.359785] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.369812] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.380410] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.390949] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.401450] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.411695] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.421792] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.431983] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.442010] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.452036] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.586 [2024-04-23 21:25:23.462063] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.472179] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.482204] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.492463] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.503020] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.513405] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.523985] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.534013] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.544038] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.554065] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.564091] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.574297] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.584321] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.594526] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.605048] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.615602] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.625895] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.636195] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.646220] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.656246] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.666270] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.676297] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.686512] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.696538] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.706564] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.716591] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.726617] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.736644] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.746667] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.756694] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.766717] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.776744] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.786768] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.796793] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.806817] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.816845] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.826870] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.836898] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.846925] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.856959] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.866977] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.877183] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.887367] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.897440] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.907634] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.917659] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.927774] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.937799] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.948069] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.958511] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.587 [2024-04-23 21:25:23.966029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:245144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:245152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:245160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:245168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:245176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:245184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:245192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:245200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:245208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:245216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:245224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:245232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:245240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:245248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:245256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:245264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:245272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.587 [2024-04-23 21:25:23.966291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:245280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.587 [2024-04-23 21:25:23.966297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:245288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:245296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:245304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:245312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:245320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:245328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:245336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:245344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:245352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:245360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:245368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:245376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:245384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:245392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:245400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:245408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:245416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:245424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:245432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:245440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:245448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:245456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:245464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:245472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:245480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:245488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:245496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:245504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:245512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:245520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:245528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:245536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:245544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:245552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:245560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:245568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:245576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:245584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.588 [2024-04-23 21:25:23.966816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:245592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.588 [2024-04-23 21:25:23.966821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:245600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:245608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:245616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:245624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:245632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:245640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:245648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:245656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:245664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:245672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:245680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:245688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:245696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.966990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.966997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:245704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:245712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:245720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:245728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:245736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:245744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:245752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.589 [2024-04-23 21:25:23.967081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:244736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:244744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:244752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:244760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:244768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:244776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:244784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:244792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:244800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:244808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:244816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:244824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:244832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:244840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:244848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:244856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:244864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.589 [2024-04-23 21:25:23.967324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:244872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x1810ef 00:25:55.589 [2024-04-23 21:25:23.967332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:244880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:244888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:244896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:244904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:244912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:244920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:244928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:244936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:244944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:244952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:244960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:244968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:244976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:244984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:244992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:245000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:245008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:245016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:245024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:245032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:245040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:245048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:245056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:245064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:245072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:245080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:245088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:245096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.590 [2024-04-23 21:25:23.967720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:245104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x1810ef 00:25:55.590 [2024-04-23 21:25:23.967726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:23.967733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:245112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x1810ef 00:25:55.591 [2024-04-23 21:25:23.967739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:23.967747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:245120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x1810ef 00:25:55.591 [2024-04-23 21:25:23.967753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:23.967761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:245128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x1810ef 00:25:55.591 [2024-04-23 21:25:23.967768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:23.979488] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:55.591 [2024-04-23 21:25:23.979501] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:55.591 [2024-04-23 21:25:23.979507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:245136 len:8 PRP1 0x0 PRP2 0x0 00:25:55.591 [2024-04-23 21:25:23.979515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:23.981754] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:23.982001] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.591 [2024-04-23 21:25:23.982014] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:23.982020] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:23.982033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:23.982044] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:23.982061] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:23.982067] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:23.982074] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:23.982090] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:23.982096] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:24.984981] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.591 [2024-04-23 21:25:24.985015] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:24.985021] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:24.985038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:24.985045] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:24.985054] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:24.985060] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:24.985067] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:24.985085] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:24.985092] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:25.987545] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.591 [2024-04-23 21:25:25.987579] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:25.987586] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:25.987602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:25.987610] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:25.987620] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:25.987626] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:25.987633] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:25.987651] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:25.987658] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:27.992484] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:27.992517] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:27.992537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:27.992549] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:27.992559] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:27.992564] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:27.992571] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:27.992589] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:27.992596] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:29.998050] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:29.998076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:29.998098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:29.998106] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:29.998117] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:29.998123] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:29.998130] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:29.998149] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:29.998156] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:32.002980] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.591 [2024-04-23 21:25:32.003008] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:55.591 [2024-04-23 21:25:32.003027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:32.003035] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:25:55.591 [2024-04-23 21:25:32.003045] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:25:55.591 [2024-04-23 21:25:32.003051] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:25:55.591 [2024-04-23 21:25:32.003059] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:25:55.591 [2024-04-23 21:25:32.003077] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.591 [2024-04-23 21:25:32.003084] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:25:55.591 [2024-04-23 21:25:33.057478] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:55.591 [2024-04-23 21:25:33.057504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.591 [2024-04-23 21:25:33.057513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:33.057521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.591 [2024-04-23 21:25:33.057527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:33.057534] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.591 [2024-04-23 21:25:33.057543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:33.057550] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.591 [2024-04-23 21:25:33.057556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:16 sqhd:83b9 p:0 m:0 dnr:0 00:25:55.591 [2024-04-23 21:25:33.059650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.591 [2024-04-23 21:25:33.059663] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.591 [2024-04-23 21:25:33.059830] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:55.591 [2024-04-23 21:25:33.067492] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.071085] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.591 [2024-04-23 21:25:33.077510] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.087534] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.097561] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.107587] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.117613] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.591 [2024-04-23 21:25:33.127641] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.137665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.147690] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.157714] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.167739] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.177765] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.187791] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.197816] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.207842] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.217869] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.227894] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.237920] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.247945] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.257972] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.267996] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.278022] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.288046] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.298072] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.308099] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.318126] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.328152] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.338176] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.348202] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.358226] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.368253] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.378283] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.388306] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.398331] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.408358] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.418384] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.428411] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.438437] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.448462] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.458488] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.468514] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.478541] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.488564] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.498589] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.508615] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.518640] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.528665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.538689] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.548716] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.558741] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.568767] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.578794] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.588821] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.598847] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.608873] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.618899] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.628926] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.638950] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.648977] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.659001] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.669028] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.679053] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.689080] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.699104] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.709130] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.719155] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.729180] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.739206] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.749231] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.759256] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.769282] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.779305] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.789329] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.799354] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.809378] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.819404] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.829428] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.839454] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.849480] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.859505] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.869529] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.879555] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.889581] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.899607] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.909634] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.919660] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.929684] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.939709] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.949734] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.959759] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.969786] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.979810] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.989834] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:33.999860] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:34.009997] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:34.020324] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:34.030679] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:34.040704] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.592 [2024-04-23 21:25:34.050732] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.593 [2024-04-23 21:25:34.061322] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:55.593 [2024-04-23 21:25:34.063578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:124944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:124952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:124960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:124968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:124976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:124984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:124992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:125000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:125008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:125016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:125024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:125032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:125040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:125048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:125056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:125064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:125072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:125080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:125088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:125096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:125104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:125112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:125120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:125128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:125136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:125144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:125152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:125160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:125168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:125176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.063992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:125184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.063998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:125192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:125200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:125208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:125216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:125224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:125232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:125240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.593 [2024-04-23 21:25:34.064089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.593 [2024-04-23 21:25:34.064097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:125248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:125256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:125264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:125272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:125280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:125288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:125296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:125304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:125312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:125320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:125328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:125336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:125344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:125352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:125360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:125368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:125376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:125384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:125392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:125400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:125408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:125416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:125424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:125432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:125440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:125448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:125456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:125464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:125472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:125480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:125488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:125496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:125504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:125512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:125520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:125528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:125536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:125544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:125552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.594 [2024-04-23 21:25:34.064611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.594 [2024-04-23 21:25:34.064618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:125560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:125568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:125576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:125584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:125592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:125600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:125608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:125616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:125624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:125632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:125640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:125648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:125656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:125664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:125672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:125680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:125688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:125696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:125704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:125712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:125720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:125728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:125736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:125744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:125752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:125760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:125768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:125776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.064988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:125784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.064994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.065001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:125792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.065007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.065014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:125800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.065020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.065027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:125808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.065033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.595 [2024-04-23 21:25:34.065039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:125816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.595 [2024-04-23 21:25:34.065045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:125824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:125832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:125840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:125848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:125856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:125864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:125872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:125880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:125888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:125896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:125904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:125912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:125920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:125928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:125936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:125944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:55.596 [2024-04-23 21:25:34.065254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.065262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:124928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bf0ef 00:25:55.596 [2024-04-23 21:25:34.065270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32575 cdw0:40d1c220 sqhd:5530 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.076967] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:55.596 [2024-04-23 21:25:34.076978] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:55.596 [2024-04-23 21:25:34.076984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124936 len:8 PRP1 0x0 PRP2 0x0 00:25:55.596 [2024-04-23 21:25:34.076990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.596 [2024-04-23 21:25:34.077031] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.596 [2024-04-23 21:25:34.078140] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.596 [2024-04-23 21:25:34.078156] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.596 [2024-04-23 21:25:34.078161] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.596 [2024-04-23 21:25:34.078174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.596 [2024-04-23 21:25:34.078181] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.596 [2024-04-23 21:25:34.078203] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.596 [2024-04-23 21:25:34.078209] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.596 [2024-04-23 21:25:34.078216] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.596 [2024-04-23 21:25:34.078232] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.596 [2024-04-23 21:25:34.078238] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.596 [2024-04-23 21:25:35.080897] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.596 [2024-04-23 21:25:35.080931] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.596 [2024-04-23 21:25:35.080937] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.596 [2024-04-23 21:25:35.080953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.596 [2024-04-23 21:25:35.080961] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.596 [2024-04-23 21:25:35.081196] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.596 [2024-04-23 21:25:35.081205] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.596 [2024-04-23 21:25:35.081211] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.596 [2024-04-23 21:25:35.081233] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.596 [2024-04-23 21:25:35.081240] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.596 [2024-04-23 21:25:36.083691] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:55.596 [2024-04-23 21:25:36.083722] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.596 [2024-04-23 21:25:36.083732] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.596 [2024-04-23 21:25:36.083748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.596 [2024-04-23 21:25:36.083755] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.596 [2024-04-23 21:25:36.083764] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.596 [2024-04-23 21:25:36.083769] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.596 [2024-04-23 21:25:36.083776] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.596 [2024-04-23 21:25:36.083793] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.596 [2024-04-23 21:25:36.083800] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.596 [2024-04-23 21:25:38.089204] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.596 [2024-04-23 21:25:38.089236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.596 [2024-04-23 21:25:38.089258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.596 [2024-04-23 21:25:38.089265] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.596 [2024-04-23 21:25:38.090046] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.596 [2024-04-23 21:25:38.090058] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.596 [2024-04-23 21:25:38.090066] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.596 [2024-04-23 21:25:38.090432] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.596 [2024-04-23 21:25:38.090443] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.596 [2024-04-23 21:25:40.095272] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.596 [2024-04-23 21:25:40.095309] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.596 [2024-04-23 21:25:40.095330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.596 [2024-04-23 21:25:40.095338] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.596 [2024-04-23 21:25:40.095349] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.596 [2024-04-23 21:25:40.095355] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.596 [2024-04-23 21:25:40.095363] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.597 [2024-04-23 21:25:40.095383] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.597 [2024-04-23 21:25:40.095391] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.597 [2024-04-23 21:25:42.100376] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:55.597 [2024-04-23 21:25:42.100403] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:55.597 [2024-04-23 21:25:42.100427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:55.597 [2024-04-23 21:25:42.100436] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:25:55.597 [2024-04-23 21:25:42.100457] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:25:55.597 [2024-04-23 21:25:42.100463] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:25:55.597 [2024-04-23 21:25:42.100470] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:25:55.597 [2024-04-23 21:25:42.100495] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:55.597 [2024-04-23 21:25:42.100501] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:25:55.597 [2024-04-23 21:25:43.152602] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.597 00:25:55.597 Latency(us) 00:25:55.597 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.597 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:25:55.597 Verification LBA range: start 0x0 length 0x8000 00:25:55.597 Nvme_mlx_0_0n1 : 90.00 11971.67 46.76 0.00 0.00 10671.60 1808.31 11035679.86 00:25:55.597 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:25:55.597 Verification LBA range: start 0x0 length 0x8000 00:25:55.597 Nvme_mlx_0_1n1 : 90.01 10607.41 41.44 0.00 0.00 12045.11 2233.08 11035679.86 00:25:55.597 =================================================================================================================== 00:25:55.597 Total : 22579.07 88.20 0.00 0.00 11316.87 1808.31 11035679.86 00:25:55.597 Received shutdown signal, test time was about 90.000000 seconds 00:25:55.597 00:25:55.597 Latency(us) 00:25:55.597 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.597 =================================================================================================================== 00:25:55.597 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:55.597 21:26:48 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:25:55.597 21:26:48 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:25:55.597 21:26:48 -- target/device_removal.sh@202 -- # killprocess 1436795 00:25:55.597 21:26:48 -- common/autotest_common.sh@936 -- # '[' -z 1436795 ']' 00:25:55.597 21:26:48 -- common/autotest_common.sh@940 -- # kill -0 1436795 00:25:55.597 21:26:48 -- common/autotest_common.sh@941 -- # uname 00:25:55.597 21:26:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:55.597 21:26:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1436795 00:25:55.597 21:26:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:55.597 21:26:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:55.597 21:26:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1436795' 00:25:55.597 killing process with pid 1436795 00:25:55.597 21:26:48 -- common/autotest_common.sh@955 -- # kill 1436795 00:25:55.597 21:26:48 -- common/autotest_common.sh@960 -- # wait 1436795 00:25:55.597 [2024-04-23 21:26:48.528473] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:55.597 21:26:48 -- target/device_removal.sh@203 -- # nvmfpid= 00:25:55.597 21:26:48 -- target/device_removal.sh@205 -- # return 0 00:25:55.597 00:25:55.597 real 1m33.159s 00:25:55.597 user 4m27.479s 00:25:55.597 sys 0m5.769s 00:25:55.597 21:26:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:55.597 21:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:55.597 ************************************ 00:25:55.597 END TEST nvmf_device_removal_pci_remove 00:25:55.597 ************************************ 00:25:55.597 21:26:48 -- target/device_removal.sh@317 -- # nvmftestfini 00:25:55.597 21:26:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:55.597 21:26:48 -- nvmf/common.sh@117 -- # sync 00:25:55.597 21:26:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:55.597 21:26:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:55.597 21:26:48 -- nvmf/common.sh@120 -- # set +e 00:25:55.597 21:26:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:55.597 21:26:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:55.597 rmmod nvme_rdma 00:25:55.597 rmmod nvme_fabrics 00:25:55.597 21:26:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:55.597 21:26:48 -- nvmf/common.sh@124 -- # set -e 00:25:55.597 21:26:48 -- nvmf/common.sh@125 -- # return 0 00:25:55.597 21:26:48 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:25:55.597 21:26:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:55.597 21:26:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:55.597 21:26:48 -- target/device_removal.sh@318 -- # clean_bond_device 00:25:55.597 21:26:48 -- target/device_removal.sh@240 -- # ip link 00:25:55.597 21:26:48 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:25:55.597 00:25:55.597 real 3m12.551s 00:25:55.597 user 8m56.874s 00:25:55.597 sys 0m15.768s 00:25:55.597 21:26:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:55.597 21:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:55.597 ************************************ 00:25:55.597 END TEST nvmf_device_removal 00:25:55.597 ************************************ 00:25:55.597 21:26:48 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:25:55.597 21:26:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:55.597 21:26:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:55.597 21:26:48 -- common/autotest_common.sh@10 -- # set +x 00:25:55.597 ************************************ 00:25:55.597 START TEST nvmf_srq_overwhelm 00:25:55.597 ************************************ 00:25:55.597 21:26:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:25:55.597 * Looking for test storage... 00:25:55.597 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:25:55.597 21:26:49 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:25:55.597 21:26:49 -- nvmf/common.sh@7 -- # uname -s 00:25:55.597 21:26:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:55.597 21:26:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:55.597 21:26:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:55.597 21:26:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:55.597 21:26:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:55.597 21:26:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:55.597 21:26:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:55.597 21:26:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:55.597 21:26:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:55.597 21:26:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:55.597 21:26:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:25:55.597 21:26:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:25:55.597 21:26:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:55.597 21:26:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:55.597 21:26:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:55.597 21:26:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:55.597 21:26:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:25:55.597 21:26:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:55.597 21:26:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:55.597 21:26:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:55.597 21:26:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.597 21:26:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.597 21:26:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.597 21:26:49 -- paths/export.sh@5 -- # export PATH 00:25:55.597 21:26:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.597 21:26:49 -- nvmf/common.sh@47 -- # : 0 00:25:55.597 21:26:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:55.597 21:26:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:55.597 21:26:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:55.597 21:26:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:55.597 21:26:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:55.597 21:26:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:55.597 21:26:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:55.597 21:26:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:55.597 21:26:49 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:55.597 21:26:49 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:55.598 21:26:49 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:25:55.598 21:26:49 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:25:55.598 21:26:49 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:55.598 21:26:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:55.598 21:26:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:55.598 21:26:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:55.598 21:26:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:55.598 21:26:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.598 21:26:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.598 21:26:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:55.598 21:26:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:55.598 21:26:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:55.598 21:26:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:55.598 21:26:49 -- common/autotest_common.sh@10 -- # set +x 00:25:59.788 21:26:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.788 21:26:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:25:59.788 21:26:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:25:59.788 21:26:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:25:59.788 21:26:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:25:59.788 21:26:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:25:59.788 21:26:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:25:59.788 21:26:53 -- nvmf/common.sh@295 -- # net_devs=() 00:25:59.788 21:26:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:25:59.788 21:26:53 -- nvmf/common.sh@296 -- # e810=() 00:25:59.788 21:26:53 -- nvmf/common.sh@296 -- # local -ga e810 00:25:59.788 21:26:53 -- nvmf/common.sh@297 -- # x722=() 00:25:59.788 21:26:53 -- nvmf/common.sh@297 -- # local -ga x722 00:25:59.788 21:26:53 -- nvmf/common.sh@298 -- # mlx=() 00:25:59.788 21:26:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:25:59.788 21:26:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.788 21:26:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:25:59.788 21:26:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:25:59.788 21:26:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:25:59.788 21:26:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:25:59.788 21:26:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:25:59.788 21:26:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:25:59.788 21:26:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:25:59.788 21:26:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:59.788 21:26:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:25:59.788 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:25:59.788 21:26:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:59.788 21:26:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:59.789 21:26:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:25:59.789 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:25:59.789 21:26:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:25:59.789 21:26:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.789 21:26:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.789 21:26:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:25:59.789 Found net devices under 0000:18:00.0: mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.789 21:26:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.789 21:26:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.789 21:26:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:25:59.789 Found net devices under 0000:18:00.1: mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.789 21:26:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:25:59.789 21:26:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:25:59.789 21:26:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:25:59.789 21:26:53 -- nvmf/common.sh@58 -- # uname 00:25:59.789 21:26:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:25:59.789 21:26:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:25:59.789 21:26:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:25:59.789 21:26:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:25:59.789 21:26:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:25:59.789 21:26:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:25:59.789 21:26:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:25:59.789 21:26:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:25:59.789 21:26:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:25:59.789 21:26:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:25:59.789 21:26:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:25:59.789 21:26:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:59.789 21:26:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:59.789 21:26:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:59.789 21:26:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:59.789 21:26:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@105 -- # continue 2 00:25:59.789 21:26:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@105 -- # continue 2 00:25:59.789 21:26:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:59.789 21:26:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:59.789 21:26:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:25:59.789 21:26:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:25:59.789 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:59.789 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:25:59.789 altname enp24s0f0np0 00:25:59.789 altname ens785f0np0 00:25:59.789 inet 192.168.100.8/24 scope global mlx_0_0 00:25:59.789 valid_lft forever preferred_lft forever 00:25:59.789 21:26:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:25:59.789 21:26:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:59.789 21:26:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:25:59.789 21:26:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:25:59.789 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:25:59.789 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:25:59.789 altname enp24s0f1np1 00:25:59.789 altname ens785f1np1 00:25:59.789 inet 192.168.100.9/24 scope global mlx_0_1 00:25:59.789 valid_lft forever preferred_lft forever 00:25:59.789 21:26:53 -- nvmf/common.sh@411 -- # return 0 00:25:59.789 21:26:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:25:59.789 21:26:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:25:59.789 21:26:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:25:59.789 21:26:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:25:59.789 21:26:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:25:59.789 21:26:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:25:59.789 21:26:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:25:59.789 21:26:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:25:59.789 21:26:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:25:59.789 21:26:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@105 -- # continue 2 00:25:59.789 21:26:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:25:59.789 21:26:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:25:59.789 21:26:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@105 -- # continue 2 00:25:59.789 21:26:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:59.789 21:26:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:59.789 21:26:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:25:59.789 21:26:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:59.789 21:26:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:59.789 21:26:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:25:59.789 192.168.100.9' 00:25:59.789 21:26:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:25:59.789 192.168.100.9' 00:25:59.789 21:26:53 -- nvmf/common.sh@446 -- # head -n 1 00:25:59.789 21:26:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:25:59.789 21:26:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:25:59.789 192.168.100.9' 00:25:59.789 21:26:53 -- nvmf/common.sh@447 -- # tail -n +2 00:25:59.789 21:26:53 -- nvmf/common.sh@447 -- # head -n 1 00:25:59.789 21:26:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:25:59.789 21:26:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:25:59.789 21:26:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:25:59.789 21:26:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:25:59.789 21:26:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:25:59.789 21:26:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:25:59.789 21:26:53 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:25:59.789 21:26:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:25:59.789 21:26:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:25:59.789 21:26:53 -- common/autotest_common.sh@10 -- # set +x 00:25:59.789 21:26:53 -- nvmf/common.sh@470 -- # nvmfpid=1457475 00:25:59.789 21:26:53 -- nvmf/common.sh@471 -- # waitforlisten 1457475 00:25:59.789 21:26:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:59.789 21:26:53 -- common/autotest_common.sh@817 -- # '[' -z 1457475 ']' 00:25:59.789 21:26:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:59.789 21:26:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:25:59.789 21:26:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:59.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:59.789 21:26:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:25:59.790 21:26:53 -- common/autotest_common.sh@10 -- # set +x 00:25:59.790 [2024-04-23 21:26:53.765412] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:25:59.790 [2024-04-23 21:26:53.765456] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.790 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.790 [2024-04-23 21:26:53.817849] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:59.790 [2024-04-23 21:26:53.884691] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:59.790 [2024-04-23 21:26:53.884732] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:59.790 [2024-04-23 21:26:53.884742] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:25:59.790 [2024-04-23 21:26:53.884747] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:25:59.790 [2024-04-23 21:26:53.884751] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:59.790 [2024-04-23 21:26:53.884792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:59.790 [2024-04-23 21:26:53.884889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:59.790 [2024-04-23 21:26:53.884961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:59.790 [2024-04-23 21:26:53.884962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.357 21:26:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:00.357 21:26:54 -- common/autotest_common.sh@850 -- # return 0 00:26:00.357 21:26:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:00.357 21:26:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:00.357 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.357 21:26:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:00.357 21:26:54 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:26:00.357 21:26:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:00.357 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.357 [2024-04-23 21:26:54.607989] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d786b0/0x1d7cba0) succeed. 00:26:00.357 [2024-04-23 21:26:54.617372] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d79cf0/0x1dbe230) succeed. 00:26:00.615 21:26:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:00.615 21:26:54 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:26:00.615 21:26:54 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:00.615 21:26:54 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:26:00.615 21:26:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:00.615 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.615 21:26:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:00.615 21:26:54 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:00.615 21:26:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:00.615 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.615 Malloc0 00:26:00.615 21:26:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:00.616 21:26:54 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:26:00.616 21:26:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:00.616 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.616 21:26:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:00.616 21:26:54 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:26:00.616 21:26:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:00.616 21:26:54 -- common/autotest_common.sh@10 -- # set +x 00:26:00.616 [2024-04-23 21:26:54.706151] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:00.616 21:26:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:00.616 21:26:54 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:26:01.549 21:26:55 -- common/autotest_common.sh@1221 -- # local i=0 00:26:01.549 21:26:55 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:01.549 21:26:55 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:26:01.549 21:26:55 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:01.549 21:26:55 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:26:01.549 21:26:55 -- common/autotest_common.sh@1232 -- # return 0 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:01.549 21:26:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:01.549 21:26:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.549 21:26:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:01.549 21:26:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:01.549 21:26:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.549 Malloc1 00:26:01.549 21:26:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:01.549 21:26:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:01.549 21:26:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.549 21:26:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:26:01.549 21:26:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:01.549 21:26:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.549 21:26:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:01.549 21:26:55 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:26:02.484 21:26:56 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:26:02.484 21:26:56 -- common/autotest_common.sh@1221 -- # local i=0 00:26:02.484 21:26:56 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:26:02.484 21:26:56 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:02.484 21:26:56 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:02.484 21:26:56 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:26:02.484 21:26:56 -- common/autotest_common.sh@1232 -- # return 0 00:26:02.484 21:26:56 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:02.484 21:26:56 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:02.484 21:26:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:02.484 21:26:56 -- common/autotest_common.sh@10 -- # set +x 00:26:02.484 21:26:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:02.484 21:26:56 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:26:02.484 21:26:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:02.484 21:26:56 -- common/autotest_common.sh@10 -- # set +x 00:26:02.484 Malloc2 00:26:02.484 21:26:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:02.484 21:26:56 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:26:02.484 21:26:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:02.484 21:26:56 -- common/autotest_common.sh@10 -- # set +x 00:26:02.742 21:26:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:02.742 21:26:56 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:26:02.742 21:26:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:02.742 21:26:56 -- common/autotest_common.sh@10 -- # set +x 00:26:02.742 21:26:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:02.742 21:26:56 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:26:03.730 21:26:57 -- common/autotest_common.sh@1221 -- # local i=0 00:26:03.730 21:26:57 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:03.730 21:26:57 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:26:03.730 21:26:57 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:03.730 21:26:57 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:26:03.730 21:26:57 -- common/autotest_common.sh@1232 -- # return 0 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:26:03.730 21:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:03.730 21:26:57 -- common/autotest_common.sh@10 -- # set +x 00:26:03.730 21:26:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:26:03.730 21:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:03.730 21:26:57 -- common/autotest_common.sh@10 -- # set +x 00:26:03.730 Malloc3 00:26:03.730 21:26:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:26:03.730 21:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:03.730 21:26:57 -- common/autotest_common.sh@10 -- # set +x 00:26:03.730 21:26:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:26:03.730 21:26:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:03.730 21:26:57 -- common/autotest_common.sh@10 -- # set +x 00:26:03.730 21:26:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:03.730 21:26:57 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:26:04.666 21:26:58 -- common/autotest_common.sh@1221 -- # local i=0 00:26:04.666 21:26:58 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:04.666 21:26:58 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:26:04.666 21:26:58 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:04.666 21:26:58 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:26:04.666 21:26:58 -- common/autotest_common.sh@1232 -- # return 0 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:26:04.666 21:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:04.666 21:26:58 -- common/autotest_common.sh@10 -- # set +x 00:26:04.666 21:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:26:04.666 21:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:04.666 21:26:58 -- common/autotest_common.sh@10 -- # set +x 00:26:04.666 Malloc4 00:26:04.666 21:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:26:04.666 21:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:04.666 21:26:58 -- common/autotest_common.sh@10 -- # set +x 00:26:04.666 21:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:26:04.666 21:26:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:04.666 21:26:58 -- common/autotest_common.sh@10 -- # set +x 00:26:04.666 21:26:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:04.666 21:26:58 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:26:05.601 21:26:59 -- common/autotest_common.sh@1221 -- # local i=0 00:26:05.601 21:26:59 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:26:05.601 21:26:59 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:05.601 21:26:59 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:05.601 21:26:59 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:26:05.601 21:26:59 -- common/autotest_common.sh@1232 -- # return 0 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:26:05.601 21:26:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:05.601 21:26:59 -- common/autotest_common.sh@10 -- # set +x 00:26:05.601 21:26:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:26:05.601 21:26:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:05.601 21:26:59 -- common/autotest_common.sh@10 -- # set +x 00:26:05.601 Malloc5 00:26:05.601 21:26:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:26:05.601 21:26:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:05.601 21:26:59 -- common/autotest_common.sh@10 -- # set +x 00:26:05.601 21:26:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:26:05.601 21:26:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:05.601 21:26:59 -- common/autotest_common.sh@10 -- # set +x 00:26:05.601 21:26:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:05.601 21:26:59 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:26:06.975 21:27:00 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:26:06.975 21:27:00 -- common/autotest_common.sh@1221 -- # local i=0 00:26:06.975 21:27:00 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:06.975 21:27:00 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:26:06.975 21:27:00 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:06.975 21:27:00 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:26:06.975 21:27:00 -- common/autotest_common.sh@1232 -- # return 0 00:26:06.976 21:27:00 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:26:06.976 [global] 00:26:06.976 thread=1 00:26:06.976 invalidate=1 00:26:06.976 rw=read 00:26:06.976 time_based=1 00:26:06.976 runtime=10 00:26:06.976 ioengine=libaio 00:26:06.976 direct=1 00:26:06.976 bs=1048576 00:26:06.976 iodepth=128 00:26:06.976 norandommap=1 00:26:06.976 numjobs=13 00:26:06.976 00:26:06.976 [job0] 00:26:06.976 filename=/dev/nvme0n1 00:26:06.976 [job1] 00:26:06.976 filename=/dev/nvme1n1 00:26:06.976 [job2] 00:26:06.976 filename=/dev/nvme2n1 00:26:06.976 [job3] 00:26:06.976 filename=/dev/nvme3n1 00:26:06.976 [job4] 00:26:06.976 filename=/dev/nvme4n1 00:26:06.976 [job5] 00:26:06.976 filename=/dev/nvme5n1 00:26:06.976 Could not set queue depth (nvme0n1) 00:26:06.976 Could not set queue depth (nvme1n1) 00:26:06.976 Could not set queue depth (nvme2n1) 00:26:06.976 Could not set queue depth (nvme3n1) 00:26:06.976 Could not set queue depth (nvme4n1) 00:26:06.976 Could not set queue depth (nvme5n1) 00:26:06.976 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:06.976 ... 00:26:06.976 fio-3.35 00:26:06.976 Starting 78 threads 00:26:19.186 00:26:19.186 job0: (groupid=0, jobs=1): err= 0: pid=1459300: Tue Apr 23 21:27:11 2024 00:26:19.186 read: IOPS=13, BW=13.9MiB/s (14.6MB/s)(143MiB/10255msec) 00:26:19.186 slat (usec): min=340, max=2198.6k, avg=71305.31, stdev=349216.23 00:26:19.186 clat (msec): min=57, max=9960, avg=8362.63, stdev=2360.49 00:26:19.186 lat (msec): min=1367, max=9960, avg=8433.94, stdev=2252.30 00:26:19.186 clat percentiles (msec): 00:26:19.186 | 1.00th=[ 1351], 5.00th=[ 1502], 10.00th=[ 4329], 20.00th=[ 8658], 00:26:19.186 | 30.00th=[ 8792], 40.00th=[ 9060], 50.00th=[ 9194], 60.00th=[ 9329], 00:26:19.186 | 70.00th=[ 9463], 80.00th=[ 9597], 90.00th=[ 9866], 95.00th=[ 9866], 00:26:19.186 | 99.00th=[10000], 99.50th=[10000], 99.90th=[10000], 99.95th=[10000], 00:26:19.186 | 99.99th=[10000] 00:26:19.186 bw ( KiB/s): min= 4096, max=16384, per=0.19%, avg=7680.00, stdev=5882.43, samples=4 00:26:19.186 iops : min= 4, max= 16, avg= 7.50, stdev= 5.74, samples=4 00:26:19.186 lat (msec) : 100=0.70%, 2000=5.59%, >=2000=93.71% 00:26:19.186 cpu : usr=0.00%, sys=0.70%, ctx=277, majf=0, minf=32769 00:26:19.186 IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.6%, 16=11.2%, 32=22.4%, >=64=55.9% 00:26:19.186 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.186 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=5.9% 00:26:19.186 issued rwts: total=143,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.186 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459301: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=65, BW=65.8MiB/s (69.0MB/s)(673MiB/10228msec) 00:26:19.187 slat (usec): min=49, max=2077.2k, avg=15137.63, stdev=137156.45 00:26:19.187 clat (msec): min=36, max=6854, avg=1799.54, stdev=2175.58 00:26:19.187 lat (msec): min=479, max=6861, avg=1814.68, stdev=2181.22 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 481], 5.00th=[ 485], 10.00th=[ 489], 20.00th=[ 502], 00:26:19.187 | 30.00th=[ 535], 40.00th=[ 550], 50.00th=[ 575], 60.00th=[ 852], 00:26:19.187 | 70.00th=[ 1318], 80.00th=[ 2702], 90.00th=[ 6544], 95.00th=[ 6678], 00:26:19.187 | 99.00th=[ 6812], 99.50th=[ 6812], 99.90th=[ 6879], 99.95th=[ 6879], 00:26:19.187 | 99.99th=[ 6879] 00:26:19.187 bw ( KiB/s): min= 4096, max=265708, per=2.99%, avg=123958.67, stdev=108607.27, samples=9 00:26:19.187 iops : min= 4, max= 259, avg=121.00, stdev=105.98, samples=9 00:26:19.187 lat (msec) : 50=0.15%, 500=18.57%, 750=39.52%, 1000=4.01%, 2000=14.41% 00:26:19.187 lat (msec) : >=2000=23.33% 00:26:19.187 cpu : usr=0.03%, sys=1.10%, ctx=774, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.6% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.187 issued rwts: total=673,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459302: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=62, BW=62.3MiB/s (65.4MB/s)(639MiB/10251msec) 00:26:19.187 slat (usec): min=39, max=2117.3k, avg=15982.38, stdev=129692.81 00:26:19.187 clat (msec): min=34, max=5061, avg=1752.89, stdev=1455.70 00:26:19.187 lat (msec): min=837, max=5065, avg=1768.87, stdev=1456.95 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 835], 5.00th=[ 852], 10.00th=[ 877], 20.00th=[ 936], 00:26:19.187 | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 969], 60.00th=[ 978], 00:26:19.187 | 70.00th=[ 1003], 80.00th=[ 2433], 90.00th=[ 4665], 95.00th=[ 4866], 00:26:19.187 | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5067], 99.95th=[ 5067], 00:26:19.187 | 99.99th=[ 5067] 00:26:19.187 bw ( KiB/s): min= 2048, max=153907, per=2.53%, avg=104655.20, stdev=57502.91, samples=10 00:26:19.187 iops : min= 2, max= 150, avg=102.10, stdev=56.08, samples=10 00:26:19.187 lat (msec) : 50=0.16%, 1000=69.64%, 2000=3.60%, >=2000=26.60% 00:26:19.187 cpu : usr=0.06%, sys=1.26%, ctx=597, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.187 issued rwts: total=639,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459303: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=70, BW=70.6MiB/s (74.0MB/s)(722MiB/10232msec) 00:26:19.187 slat (usec): min=45, max=2090.8k, avg=14108.87, stdev=132717.97 00:26:19.187 clat (msec): min=42, max=6791, avg=1689.61, stdev=2209.53 00:26:19.187 lat (msec): min=504, max=6793, avg=1703.72, stdev=2214.77 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 510], 5.00th=[ 542], 10.00th=[ 558], 20.00th=[ 592], 00:26:19.187 | 30.00th=[ 617], 40.00th=[ 659], 50.00th=[ 676], 60.00th=[ 709], 00:26:19.187 | 70.00th=[ 726], 80.00th=[ 953], 90.00th=[ 6477], 95.00th=[ 6678], 00:26:19.187 | 99.00th=[ 6745], 99.50th=[ 6812], 99.90th=[ 6812], 99.95th=[ 6812], 00:26:19.187 | 99.99th=[ 6812] 00:26:19.187 bw ( KiB/s): min= 6144, max=243712, per=3.67%, avg=152012.38, stdev=92016.03, samples=8 00:26:19.187 iops : min= 6, max= 238, avg=148.38, stdev=89.81, samples=8 00:26:19.187 lat (msec) : 50=0.14%, 750=73.13%, 1000=8.03%, >=2000=18.70% 00:26:19.187 cpu : usr=0.00%, sys=1.09%, ctx=799, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.4%, >=64=91.3% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.187 issued rwts: total=722,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459304: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=80, BW=80.5MiB/s (84.5MB/s)(822MiB/10205msec) 00:26:19.187 slat (usec): min=50, max=2118.8k, avg=12164.27, stdev=104398.86 00:26:19.187 clat (msec): min=202, max=5184, avg=1477.82, stdev=1507.56 00:26:19.187 lat (msec): min=205, max=5190, avg=1489.99, stdev=1513.16 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 232], 5.00th=[ 502], 10.00th=[ 735], 20.00th=[ 802], 00:26:19.187 | 30.00th=[ 810], 40.00th=[ 818], 50.00th=[ 835], 60.00th=[ 852], 00:26:19.187 | 70.00th=[ 877], 80.00th=[ 1167], 90.00th=[ 5067], 95.00th=[ 5134], 00:26:19.187 | 99.00th=[ 5134], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], 00:26:19.187 | 99.99th=[ 5201] 00:26:19.187 bw ( KiB/s): min=24576, max=161792, per=2.80%, avg=116019.55, stdev=59046.53, samples=11 00:26:19.187 iops : min= 24, max= 158, avg=113.27, stdev=57.64, samples=11 00:26:19.187 lat (msec) : 250=1.22%, 500=3.77%, 750=5.60%, 1000=64.96%, 2000=7.06% 00:26:19.187 lat (msec) : >=2000=17.40% 00:26:19.187 cpu : usr=0.02%, sys=1.04%, ctx=922, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.3% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.187 issued rwts: total=822,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459305: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=2, BW=2607KiB/s (2670kB/s)(26.0MiB/10212msec) 00:26:19.187 slat (msec): min=3, max=2121, avg=391.24, stdev=794.91 00:26:19.187 clat (msec): min=38, max=10193, avg=7033.54, stdev=3148.48 00:26:19.187 lat (msec): min=2127, max=10211, avg=7424.78, stdev=2863.66 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 39], 5.00th=[ 2123], 10.00th=[ 2140], 20.00th=[ 4329], 00:26:19.187 | 30.00th=[ 6409], 40.00th=[ 6477], 50.00th=[ 8557], 60.00th=[ 8658], 00:26:19.187 | 70.00th=[ 8658], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:26:19.187 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.187 | 99.99th=[10134] 00:26:19.187 lat (msec) : 50=3.85%, >=2000=96.15% 00:26:19.187 cpu : usr=0.00%, sys=0.13%, ctx=61, majf=0, minf=6657 00:26:19.187 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:19.187 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459306: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=49, BW=50.0MiB/s (52.4MB/s)(511MiB/10224msec) 00:26:19.187 slat (usec): min=430, max=2144.0k, avg=19902.89, stdev=160896.46 00:26:19.187 clat (msec): min=51, max=6426, avg=2340.80, stdev=1909.84 00:26:19.187 lat (msec): min=647, max=6442, avg=2360.70, stdev=1911.66 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 642], 5.00th=[ 659], 10.00th=[ 667], 20.00th=[ 684], 00:26:19.187 | 30.00th=[ 693], 40.00th=[ 701], 50.00th=[ 2123], 60.00th=[ 2467], 00:26:19.187 | 70.00th=[ 2769], 80.00th=[ 5201], 90.00th=[ 5403], 95.00th=[ 5604], 00:26:19.187 | 99.00th=[ 5671], 99.50th=[ 6409], 99.90th=[ 6409], 99.95th=[ 6409], 00:26:19.187 | 99.99th=[ 6409] 00:26:19.187 bw ( KiB/s): min= 6144, max=196608, per=2.10%, avg=87153.78, stdev=90071.91, samples=9 00:26:19.187 iops : min= 6, max= 192, avg=85.11, stdev=87.96, samples=9 00:26:19.187 lat (msec) : 100=0.20%, 750=45.40%, 1000=1.37%, 2000=2.94%, >=2000=50.10% 00:26:19.187 cpu : usr=0.00%, sys=0.94%, ctx=1382, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.7% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.187 issued rwts: total=511,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459307: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=124, BW=124MiB/s (130MB/s)(1269MiB/10218msec) 00:26:19.187 slat (usec): min=43, max=2066.2k, avg=8011.33, stdev=58466.86 00:26:19.187 clat (msec): min=47, max=3124, avg=931.50, stdev=629.62 00:26:19.187 lat (msec): min=313, max=3127, avg=939.51, stdev=631.30 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 321], 5.00th=[ 363], 10.00th=[ 376], 20.00th=[ 443], 00:26:19.187 | 30.00th=[ 651], 40.00th=[ 726], 50.00th=[ 827], 60.00th=[ 869], 00:26:19.187 | 70.00th=[ 919], 80.00th=[ 978], 90.00th=[ 2106], 95.00th=[ 2635], 00:26:19.187 | 99.00th=[ 3004], 99.50th=[ 3071], 99.90th=[ 3104], 99.95th=[ 3138], 00:26:19.187 | 99.99th=[ 3138] 00:26:19.187 bw ( KiB/s): min= 4096, max=342016, per=4.03%, avg=166887.14, stdev=78407.07, samples=14 00:26:19.187 iops : min= 4, max= 334, avg=162.93, stdev=76.57, samples=14 00:26:19.187 lat (msec) : 50=0.08%, 500=20.96%, 750=21.12%, 1000=39.32%, 2000=8.51% 00:26:19.187 lat (msec) : >=2000=10.01% 00:26:19.187 cpu : usr=0.02%, sys=1.32%, ctx=2632, majf=0, minf=32769 00:26:19.187 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.3%, 32=2.5%, >=64=95.0% 00:26:19.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.187 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.187 issued rwts: total=1269,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.187 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.187 job0: (groupid=0, jobs=1): err= 0: pid=1459308: Tue Apr 23 21:27:11 2024 00:26:19.187 read: IOPS=70, BW=70.7MiB/s (74.2MB/s)(730MiB/10321msec) 00:26:19.187 slat (usec): min=70, max=2107.0k, avg=14064.87, stdev=132892.08 00:26:19.187 clat (msec): min=51, max=6426, avg=1744.62, stdev=1710.29 00:26:19.187 lat (msec): min=475, max=6442, avg=1758.69, stdev=1719.23 00:26:19.187 clat percentiles (msec): 00:26:19.187 | 1.00th=[ 481], 5.00th=[ 493], 10.00th=[ 498], 20.00th=[ 535], 00:26:19.187 | 30.00th=[ 642], 40.00th=[ 684], 50.00th=[ 693], 60.00th=[ 718], 00:26:19.187 | 70.00th=[ 2400], 80.00th=[ 2836], 90.00th=[ 5067], 95.00th=[ 5134], 00:26:19.187 | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 6409], 99.95th=[ 6409], 00:26:19.187 | 99.99th=[ 6409] 00:26:19.187 bw ( KiB/s): min= 8192, max=248304, per=2.98%, avg=123304.00, stdev=84456.41, samples=10 00:26:19.187 iops : min= 8, max= 242, avg=120.20, stdev=82.48, samples=10 00:26:19.188 lat (msec) : 100=0.14%, 500=10.14%, 750=53.84%, 1000=0.68%, >=2000=35.21% 00:26:19.188 cpu : usr=0.03%, sys=1.32%, ctx=1443, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.2%, 32=4.4%, >=64=91.4% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.188 issued rwts: total=730,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job0: (groupid=0, jobs=1): err= 0: pid=1459309: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=115, BW=116MiB/s (121MB/s)(1186MiB/10250msec) 00:26:19.188 slat (usec): min=32, max=2091.8k, avg=8608.81, stdev=84842.10 00:26:19.188 clat (msec): min=36, max=4715, avg=1049.36, stdev=1258.17 00:26:19.188 lat (msec): min=212, max=4715, avg=1057.97, stdev=1261.45 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 224], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 239], 00:26:19.188 | 30.00th=[ 284], 40.00th=[ 542], 50.00th=[ 735], 60.00th=[ 760], 00:26:19.188 | 70.00th=[ 1011], 80.00th=[ 1116], 90.00th=[ 4212], 95.00th=[ 4597], 00:26:19.188 | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], 00:26:19.188 | 99.99th=[ 4732] 00:26:19.188 bw ( KiB/s): min= 6144, max=559104, per=4.36%, avg=180563.25, stdev=150944.02, samples=12 00:26:19.188 iops : min= 6, max= 546, avg=176.25, stdev=147.51, samples=12 00:26:19.188 lat (msec) : 50=0.08%, 250=28.75%, 500=9.78%, 750=19.22%, 1000=11.05% 00:26:19.188 lat (msec) : 2000=20.15%, >=2000=10.96% 00:26:19.188 cpu : usr=0.04%, sys=1.34%, ctx=1830, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.7%, >=64=94.7% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.188 issued rwts: total=1186,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job0: (groupid=0, jobs=1): err= 0: pid=1459310: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=15, BW=15.5MiB/s (16.2MB/s)(158MiB/10225msec) 00:26:19.188 slat (usec): min=343, max=2131.2k, avg=64414.11, stdev=330916.63 00:26:19.188 clat (msec): min=46, max=9740, avg=7576.96, stdev=2931.90 00:26:19.188 lat (msec): min=1213, max=9746, avg=7641.38, stdev=2868.84 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 1200], 5.00th=[ 1250], 10.00th=[ 1334], 20.00th=[ 5470], 00:26:19.188 | 30.00th=[ 8658], 40.00th=[ 8792], 50.00th=[ 8926], 60.00th=[ 9060], 00:26:19.188 | 70.00th=[ 9194], 80.00th=[ 9463], 90.00th=[ 9597], 95.00th=[ 9731], 00:26:19.188 | 99.00th=[ 9731], 99.50th=[ 9731], 99.90th=[ 9731], 99.95th=[ 9731], 00:26:19.188 | 99.99th=[ 9731] 00:26:19.188 bw ( KiB/s): min= 4096, max=22528, per=0.30%, avg=12288.00, stdev=7931.87, samples=5 00:26:19.188 iops : min= 4, max= 22, avg=12.00, stdev= 7.75, samples=5 00:26:19.188 lat (msec) : 50=0.63%, 2000=12.66%, >=2000=86.71% 00:26:19.188 cpu : usr=0.00%, sys=0.57%, ctx=339, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.6%, 2=1.3%, 4=2.5%, 8=5.1%, 16=10.1%, 32=20.3%, >=64=60.1% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=96.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=3.1% 00:26:19.188 issued rwts: total=158,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job0: (groupid=0, jobs=1): err= 0: pid=1459311: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=2, BW=2287KiB/s (2342kB/s)(23.0MiB/10296msec) 00:26:19.188 slat (usec): min=776, max=2143.6k, avg=445936.60, stdev=846265.72 00:26:19.188 clat (msec): min=39, max=10289, avg=7993.14, stdev=3210.10 00:26:19.188 lat (msec): min=2124, max=10295, avg=8439.08, stdev=2731.69 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 40], 5.00th=[ 2123], 10.00th=[ 4279], 20.00th=[ 4329], 00:26:19.188 | 30.00th=[ 6477], 40.00th=[10134], 50.00th=[10134], 60.00th=[10268], 00:26:19.188 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.188 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.188 | 99.99th=[10268] 00:26:19.188 lat (msec) : 50=4.35%, >=2000=95.65% 00:26:19.188 cpu : usr=0.00%, sys=0.17%, ctx=73, majf=0, minf=5889 00:26:19.188 IO depths : 1=4.3%, 2=8.7%, 4=17.4%, 8=34.8%, 16=34.8%, 32=0.0%, >=64=0.0% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:19.188 issued rwts: total=23,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job0: (groupid=0, jobs=1): err= 0: pid=1459312: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=6, BW=6849KiB/s (7014kB/s)(69.0MiB/10316msec) 00:26:19.188 slat (usec): min=504, max=2124.6k, avg=148815.96, stdev=509142.25 00:26:19.188 clat (msec): min=46, max=10314, avg=8931.97, stdev=2541.25 00:26:19.188 lat (msec): min=2124, max=10315, avg=9080.78, stdev=2302.74 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 47], 5.00th=[ 2165], 10.00th=[ 4329], 20.00th=[ 6477], 00:26:19.188 | 30.00th=[10000], 40.00th=[10134], 50.00th=[10268], 60.00th=[10268], 00:26:19.188 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.188 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.188 | 99.99th=[10268] 00:26:19.188 lat (msec) : 50=1.45%, >=2000=98.55% 00:26:19.188 cpu : usr=0.00%, sys=0.42%, ctx=133, majf=0, minf=17665 00:26:19.188 IO depths : 1=1.4%, 2=2.9%, 4=5.8%, 8=11.6%, 16=23.2%, 32=46.4%, >=64=8.7% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.188 issued rwts: total=69,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job1: (groupid=0, jobs=1): err= 0: pid=1459313: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=16, BW=16.1MiB/s (16.9MB/s)(164MiB/10165msec) 00:26:19.188 slat (usec): min=414, max=2088.9k, avg=61717.15, stdev=289332.17 00:26:19.188 clat (msec): min=42, max=7498, avg=3271.70, stdev=1330.25 00:26:19.188 lat (msec): min=1847, max=7511, avg=3333.41, stdev=1344.81 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 1821], 5.00th=[ 1854], 10.00th=[ 1871], 20.00th=[ 2299], 00:26:19.188 | 30.00th=[ 2635], 40.00th=[ 2836], 50.00th=[ 3104], 60.00th=[ 3306], 00:26:19.188 | 70.00th=[ 3507], 80.00th=[ 3742], 90.00th=[ 3943], 95.00th=[ 7416], 00:26:19.188 | 99.00th=[ 7483], 99.50th=[ 7483], 99.90th=[ 7483], 99.95th=[ 7483], 00:26:19.188 | 99.99th=[ 7483] 00:26:19.188 bw ( KiB/s): min= 2048, max=63488, per=0.59%, avg=24576.00, stdev=33838.51, samples=3 00:26:19.188 iops : min= 2, max= 62, avg=24.00, stdev=33.05, samples=3 00:26:19.188 lat (msec) : 50=0.61%, 2000=10.98%, >=2000=88.41% 00:26:19.188 cpu : usr=0.00%, sys=0.68%, ctx=413, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.9%, 16=9.8%, 32=19.5%, >=64=61.6% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=97.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.6% 00:26:19.188 issued rwts: total=164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job1: (groupid=0, jobs=1): err= 0: pid=1459314: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=42, BW=42.5MiB/s (44.6MB/s)(434MiB/10206msec) 00:26:19.188 slat (usec): min=74, max=2141.4k, avg=23426.72, stdev=157638.58 00:26:19.188 clat (msec): min=36, max=5106, avg=2302.08, stdev=1630.57 00:26:19.188 lat (msec): min=834, max=5106, avg=2325.50, stdev=1629.15 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 835], 5.00th=[ 844], 10.00th=[ 860], 20.00th=[ 894], 00:26:19.188 | 30.00th=[ 944], 40.00th=[ 1183], 50.00th=[ 1536], 60.00th=[ 1854], 00:26:19.188 | 70.00th=[ 3574], 80.00th=[ 4530], 90.00th=[ 4799], 95.00th=[ 5000], 00:26:19.188 | 99.00th=[ 5067], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], 00:26:19.188 | 99.99th=[ 5134] 00:26:19.188 bw ( KiB/s): min= 2048, max=149803, per=2.16%, avg=89647.43, stdev=65280.78, samples=7 00:26:19.188 iops : min= 2, max= 146, avg=87.43, stdev=63.64, samples=7 00:26:19.188 lat (msec) : 50=0.23%, 1000=35.02%, 2000=28.11%, >=2000=36.64% 00:26:19.188 cpu : usr=0.00%, sys=1.15%, ctx=594, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.7%, 32=7.4%, >=64=85.5% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.188 issued rwts: total=434,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job1: (groupid=0, jobs=1): err= 0: pid=1459315: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=16, BW=16.5MiB/s (17.3MB/s)(168MiB/10210msec) 00:26:19.188 slat (usec): min=618, max=2071.8k, avg=60383.73, stdev=289928.39 00:26:19.188 clat (msec): min=64, max=8618, avg=5817.95, stdev=2055.91 00:26:19.188 lat (msec): min=2052, max=8628, avg=5878.33, stdev=1995.45 00:26:19.188 clat percentiles (msec): 00:26:19.188 | 1.00th=[ 2022], 5.00th=[ 2072], 10.00th=[ 2089], 20.00th=[ 3910], 00:26:19.188 | 30.00th=[ 5873], 40.00th=[ 6409], 50.00th=[ 6678], 60.00th=[ 6946], 00:26:19.188 | 70.00th=[ 7215], 80.00th=[ 7483], 90.00th=[ 7752], 95.00th=[ 7886], 00:26:19.188 | 99.00th=[ 7953], 99.50th=[ 8658], 99.90th=[ 8658], 99.95th=[ 8658], 00:26:19.188 | 99.99th=[ 8658] 00:26:19.188 bw ( KiB/s): min=16384, max=43008, per=0.66%, avg=27306.67, stdev=13940.45, samples=3 00:26:19.188 iops : min= 16, max= 42, avg=26.67, stdev=13.61, samples=3 00:26:19.188 lat (msec) : 100=0.60%, >=2000=99.40% 00:26:19.188 cpu : usr=0.01%, sys=0.86%, ctx=335, majf=0, minf=32769 00:26:19.188 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.8%, 16=9.5%, 32=19.0%, >=64=62.5% 00:26:19.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.188 complete : 0=0.0%, 4=97.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.4% 00:26:19.188 issued rwts: total=168,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.188 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.188 job1: (groupid=0, jobs=1): err= 0: pid=1459316: Tue Apr 23 21:27:11 2024 00:26:19.188 read: IOPS=19, BW=19.8MiB/s (20.8MB/s)(204MiB/10305msec) 00:26:19.188 slat (usec): min=124, max=2112.9k, avg=50267.58, stdev=283901.08 00:26:19.188 clat (msec): min=48, max=9778, avg=6154.53, stdev=3736.79 00:26:19.189 lat (msec): min=797, max=9782, avg=6204.80, stdev=3717.46 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 793], 5.00th=[ 810], 10.00th=[ 827], 20.00th=[ 877], 00:26:19.189 | 30.00th=[ 2198], 40.00th=[ 6409], 50.00th=[ 8423], 60.00th=[ 9329], 00:26:19.189 | 70.00th=[ 9463], 80.00th=[ 9597], 90.00th=[ 9597], 95.00th=[ 9731], 00:26:19.189 | 99.00th=[ 9731], 99.50th=[ 9731], 99.90th=[ 9731], 99.95th=[ 9731], 00:26:19.189 | 99.99th=[ 9731] 00:26:19.189 bw ( KiB/s): min= 2043, max=57344, per=0.54%, avg=22234.71, stdev=19409.33, samples=7 00:26:19.189 iops : min= 1, max= 56, avg=21.57, stdev=19.13, samples=7 00:26:19.189 lat (msec) : 50=0.49%, 1000=19.61%, 2000=8.33%, >=2000=71.57% 00:26:19.189 cpu : usr=0.00%, sys=0.94%, ctx=305, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=3.9%, 16=7.8%, 32=15.7%, >=64=69.1% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=98.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.3% 00:26:19.189 issued rwts: total=204,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459317: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=77, BW=77.3MiB/s (81.1MB/s)(792MiB/10244msec) 00:26:19.189 slat (usec): min=43, max=2088.5k, avg=12839.82, stdev=107349.13 00:26:19.189 clat (msec): min=72, max=6879, avg=1564.63, stdev=1812.29 00:26:19.189 lat (msec): min=241, max=6885, avg=1577.47, stdev=1820.66 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 243], 5.00th=[ 247], 10.00th=[ 249], 20.00th=[ 317], 00:26:19.189 | 30.00th=[ 430], 40.00th=[ 667], 50.00th=[ 818], 60.00th=[ 927], 00:26:19.189 | 70.00th=[ 1062], 80.00th=[ 3440], 90.00th=[ 3910], 95.00th=[ 6544], 00:26:19.189 | 99.00th=[ 6812], 99.50th=[ 6879], 99.90th=[ 6879], 99.95th=[ 6879], 00:26:19.189 | 99.99th=[ 6879] 00:26:19.189 bw ( KiB/s): min= 4104, max=300455, per=2.74%, avg=113279.33, stdev=99268.71, samples=12 00:26:19.189 iops : min= 4, max= 293, avg=110.58, stdev=96.88, samples=12 00:26:19.189 lat (msec) : 100=0.13%, 250=12.12%, 500=22.98%, 750=8.96%, 1000=21.46% 00:26:19.189 lat (msec) : 2000=8.96%, >=2000=25.38% 00:26:19.189 cpu : usr=0.00%, sys=0.98%, ctx=1639, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.0% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.189 issued rwts: total=792,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459318: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=3, BW=3221KiB/s (3298kB/s)(32.0MiB/10174msec) 00:26:19.189 slat (msec): min=3, max=2115, avg=316.70, stdev=695.92 00:26:19.189 clat (msec): min=38, max=8599, avg=6207.23, stdev=2801.60 00:26:19.189 lat (msec): min=2090, max=10173, avg=6523.92, stdev=2650.54 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 39], 5.00th=[ 2089], 10.00th=[ 2106], 20.00th=[ 2123], 00:26:19.189 | 30.00th=[ 4279], 40.00th=[ 6409], 50.00th=[ 8154], 60.00th=[ 8221], 00:26:19.189 | 70.00th=[ 8356], 80.00th=[ 8423], 90.00th=[ 8490], 95.00th=[ 8557], 00:26:19.189 | 99.00th=[ 8658], 99.50th=[ 8658], 99.90th=[ 8658], 99.95th=[ 8658], 00:26:19.189 | 99.99th=[ 8658] 00:26:19.189 lat (msec) : 50=3.12%, >=2000=96.88% 00:26:19.189 cpu : usr=0.00%, sys=0.21%, ctx=122, majf=0, minf=8193 00:26:19.189 IO depths : 1=3.1%, 2=6.2%, 4=12.5%, 8=25.0%, 16=50.0%, 32=3.1%, >=64=0.0% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:19.189 issued rwts: total=32,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459319: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=39, BW=39.8MiB/s (41.7MB/s)(409MiB/10273msec) 00:26:19.189 slat (usec): min=106, max=2105.0k, avg=24973.20, stdev=164491.68 00:26:19.189 clat (msec): min=57, max=6794, avg=2080.10, stdev=1673.54 00:26:19.189 lat (msec): min=654, max=6798, avg=2105.07, stdev=1687.08 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 651], 5.00th=[ 659], 10.00th=[ 693], 20.00th=[ 810], 00:26:19.189 | 30.00th=[ 1116], 40.00th=[ 1418], 50.00th=[ 1620], 60.00th=[ 1804], 00:26:19.189 | 70.00th=[ 2022], 80.00th=[ 2265], 90.00th=[ 5336], 95.00th=[ 6611], 00:26:19.189 | 99.00th=[ 6745], 99.50th=[ 6745], 99.90th=[ 6812], 99.95th=[ 6812], 00:26:19.189 | 99.99th=[ 6812] 00:26:19.189 bw ( KiB/s): min= 2048, max=188416, per=2.31%, avg=95865.50, stdev=67787.01, samples=6 00:26:19.189 iops : min= 2, max= 184, avg=93.33, stdev=66.31, samples=6 00:26:19.189 lat (msec) : 100=0.24%, 750=16.14%, 1000=9.05%, 2000=42.30%, >=2000=32.27% 00:26:19.189 cpu : usr=0.00%, sys=0.89%, ctx=647, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=3.9%, 32=7.8%, >=64=84.6% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.189 issued rwts: total=409,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459320: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=68, BW=68.0MiB/s (71.3MB/s)(697MiB/10246msec) 00:26:19.189 slat (usec): min=43, max=2090.0k, avg=14600.90, stdev=136221.45 00:26:19.189 clat (msec): min=66, max=7024, avg=1730.53, stdev=2275.57 00:26:19.189 lat (msec): min=375, max=7026, avg=1745.13, stdev=2281.50 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 376], 5.00th=[ 472], 10.00th=[ 493], 20.00th=[ 518], 00:26:19.189 | 30.00th=[ 558], 40.00th=[ 592], 50.00th=[ 617], 60.00th=[ 701], 00:26:19.189 | 70.00th=[ 751], 80.00th=[ 2165], 90.00th=[ 6745], 95.00th=[ 6879], 00:26:19.189 | 99.00th=[ 6946], 99.50th=[ 7013], 99.90th=[ 7013], 99.95th=[ 7013], 00:26:19.189 | 99.99th=[ 7013] 00:26:19.189 bw ( KiB/s): min=20480, max=253952, per=3.52%, avg=145669.12, stdev=94024.74, samples=8 00:26:19.189 iops : min= 20, max= 248, avg=142.25, stdev=91.83, samples=8 00:26:19.189 lat (msec) : 100=0.14%, 500=17.65%, 750=52.65%, 1000=5.31%, 2000=3.16% 00:26:19.189 lat (msec) : >=2000=21.09% 00:26:19.189 cpu : usr=0.01%, sys=0.91%, ctx=849, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.3%, 32=4.6%, >=64=91.0% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.189 issued rwts: total=697,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459321: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=47, BW=47.3MiB/s (49.6MB/s)(483MiB/10214msec) 00:26:19.189 slat (usec): min=45, max=2101.3k, avg=21055.96, stdev=163437.56 00:26:19.189 clat (msec): min=42, max=5669, avg=2575.74, stdev=1738.33 00:26:19.189 lat (msec): min=711, max=5695, avg=2596.80, stdev=1739.25 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 718], 20.00th=[ 776], 00:26:19.189 | 30.00th=[ 852], 40.00th=[ 1519], 50.00th=[ 2333], 60.00th=[ 2836], 00:26:19.189 | 70.00th=[ 3272], 80.00th=[ 5000], 90.00th=[ 5269], 95.00th=[ 5470], 00:26:19.189 | 99.00th=[ 5604], 99.50th=[ 5671], 99.90th=[ 5671], 99.95th=[ 5671], 00:26:19.189 | 99.99th=[ 5671] 00:26:19.189 bw ( KiB/s): min=20480, max=186368, per=1.76%, avg=72688.00, stdev=50230.35, samples=10 00:26:19.189 iops : min= 20, max= 182, avg=70.90, stdev=49.04, samples=10 00:26:19.189 lat (msec) : 50=0.21%, 750=18.84%, 1000=11.39%, 2000=14.70%, >=2000=54.87% 00:26:19.189 cpu : usr=0.00%, sys=0.99%, ctx=597, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.189 issued rwts: total=483,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459322: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=56, BW=56.3MiB/s (59.0MB/s)(577MiB/10257msec) 00:26:19.189 slat (usec): min=62, max=2083.1k, avg=17669.62, stdev=149106.94 00:26:19.189 clat (msec): min=59, max=6969, avg=2118.94, stdev=2356.71 00:26:19.189 lat (msec): min=466, max=7007, avg=2136.61, stdev=2361.12 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 485], 5.00th=[ 510], 10.00th=[ 542], 20.00th=[ 567], 00:26:19.189 | 30.00th=[ 751], 40.00th=[ 902], 50.00th=[ 986], 60.00th=[ 1116], 00:26:19.189 | 70.00th=[ 1167], 80.00th=[ 4933], 90.00th=[ 6678], 95.00th=[ 6745], 00:26:19.189 | 99.00th=[ 6946], 99.50th=[ 6946], 99.90th=[ 6946], 99.95th=[ 6946], 00:26:19.189 | 99.99th=[ 6946] 00:26:19.189 bw ( KiB/s): min=10240, max=227328, per=2.78%, avg=114944.00, stdev=74812.59, samples=8 00:26:19.189 iops : min= 10, max= 222, avg=112.25, stdev=73.06, samples=8 00:26:19.189 lat (msec) : 100=0.17%, 500=3.64%, 750=26.34%, 1000=20.62%, 2000=24.96% 00:26:19.189 lat (msec) : >=2000=24.26% 00:26:19.189 cpu : usr=0.01%, sys=0.88%, ctx=930, majf=0, minf=32769 00:26:19.189 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.5%, >=64=89.1% 00:26:19.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.189 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.189 issued rwts: total=577,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.189 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.189 job1: (groupid=0, jobs=1): err= 0: pid=1459323: Tue Apr 23 21:27:11 2024 00:26:19.189 read: IOPS=35, BW=35.1MiB/s (36.8MB/s)(362MiB/10323msec) 00:26:19.189 slat (usec): min=152, max=2083.0k, avg=28353.49, stdev=194574.86 00:26:19.189 clat (msec): min=57, max=8515, avg=3518.70, stdev=3176.23 00:26:19.189 lat (msec): min=748, max=8517, avg=3547.06, stdev=3178.57 00:26:19.189 clat percentiles (msec): 00:26:19.189 | 1.00th=[ 751], 5.00th=[ 860], 10.00th=[ 1003], 20.00th=[ 1083], 00:26:19.189 | 30.00th=[ 1167], 40.00th=[ 1217], 50.00th=[ 1234], 60.00th=[ 1284], 00:26:19.189 | 70.00th=[ 7483], 80.00th=[ 7819], 90.00th=[ 8154], 95.00th=[ 8356], 00:26:19.189 | 99.00th=[ 8490], 99.50th=[ 8490], 99.90th=[ 8490], 99.95th=[ 8490], 00:26:19.189 | 99.99th=[ 8490] 00:26:19.189 bw ( KiB/s): min= 4096, max=102400, per=1.29%, avg=53222.33, stdev=47182.69, samples=9 00:26:19.189 iops : min= 4, max= 100, avg=51.67, stdev=46.22, samples=9 00:26:19.189 lat (msec) : 100=0.28%, 750=0.28%, 1000=8.84%, 2000=51.66%, >=2000=38.95% 00:26:19.189 cpu : usr=0.00%, sys=0.78%, ctx=735, majf=0, minf=31893 00:26:19.189 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.2%, 16=4.4%, 32=8.8%, >=64=82.6% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.190 issued rwts: total=362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job1: (groupid=0, jobs=1): err= 0: pid=1459324: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=107, BW=108MiB/s (113MB/s)(1105MiB/10250msec) 00:26:19.190 slat (usec): min=41, max=2085.0k, avg=9204.77, stdev=65052.75 00:26:19.190 clat (msec): min=75, max=4095, avg=1123.10, stdev=876.78 00:26:19.190 lat (msec): min=249, max=4101, avg=1132.30, stdev=880.12 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 288], 20.00th=[ 388], 00:26:19.190 | 30.00th=[ 600], 40.00th=[ 852], 50.00th=[ 944], 60.00th=[ 1062], 00:26:19.190 | 70.00th=[ 1200], 80.00th=[ 1418], 90.00th=[ 2668], 95.00th=[ 3339], 00:26:19.190 | 99.00th=[ 3977], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4111], 00:26:19.190 | 99.99th=[ 4111] 00:26:19.190 bw ( KiB/s): min= 4096, max=313344, per=3.02%, avg=125091.62, stdev=79723.76, samples=16 00:26:19.190 iops : min= 4, max= 306, avg=122.13, stdev=77.78, samples=16 00:26:19.190 lat (msec) : 100=0.09%, 250=5.97%, 500=20.27%, 750=7.60%, 1000=21.54% 00:26:19.190 lat (msec) : 2000=33.03%, >=2000=11.49% 00:26:19.190 cpu : usr=0.02%, sys=1.13%, ctx=1801, majf=0, minf=32769 00:26:19.190 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.9%, >=64=94.3% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.190 issued rwts: total=1105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job1: (groupid=0, jobs=1): err= 0: pid=1459325: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=39, BW=40.0MiB/s (41.9MB/s)(412MiB/10309msec) 00:26:19.190 slat (usec): min=89, max=2097.9k, avg=24898.50, stdev=178103.17 00:26:19.190 clat (msec): min=48, max=7520, avg=3092.86, stdev=2596.61 00:26:19.190 lat (msec): min=695, max=7521, avg=3117.75, stdev=2597.47 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 701], 5.00th=[ 835], 10.00th=[ 953], 20.00th=[ 1183], 00:26:19.190 | 30.00th=[ 1267], 40.00th=[ 1469], 50.00th=[ 1687], 60.00th=[ 1804], 00:26:19.190 | 70.00th=[ 5403], 80.00th=[ 6812], 90.00th=[ 7148], 95.00th=[ 7416], 00:26:19.190 | 99.00th=[ 7483], 99.50th=[ 7483], 99.90th=[ 7550], 99.95th=[ 7550], 00:26:19.190 | 99.99th=[ 7550] 00:26:19.190 bw ( KiB/s): min= 2043, max=120832, per=1.40%, avg=58162.70, stdev=42240.10, samples=10 00:26:19.190 iops : min= 1, max= 118, avg=56.70, stdev=41.40, samples=10 00:26:19.190 lat (msec) : 50=0.24%, 750=1.21%, 1000=14.56%, 2000=51.70%, >=2000=32.28% 00:26:19.190 cpu : usr=0.04%, sys=0.87%, ctx=740, majf=0, minf=32769 00:26:19.190 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.9%, 32=7.8%, >=64=84.7% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.190 issued rwts: total=412,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459326: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=9, BW=9.94MiB/s (10.4MB/s)(102MiB/10261msec) 00:26:19.190 slat (usec): min=323, max=2092.8k, avg=100073.12, stdev=392409.96 00:26:19.190 clat (msec): min=53, max=10257, avg=7109.44, stdev=2703.56 00:26:19.190 lat (msec): min=2096, max=10260, avg=7209.52, stdev=2627.63 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 2089], 5.00th=[ 4111], 10.00th=[ 4111], 20.00th=[ 4245], 00:26:19.190 | 30.00th=[ 5537], 40.00th=[ 6141], 50.00th=[ 6409], 60.00th=[ 8557], 00:26:19.190 | 70.00th=[10134], 80.00th=[10134], 90.00th=[10268], 95.00th=[10268], 00:26:19.190 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.190 | 99.99th=[10268] 00:26:19.190 lat (msec) : 100=0.98%, >=2000=99.02% 00:26:19.190 cpu : usr=0.00%, sys=0.64%, ctx=194, majf=0, minf=26113 00:26:19.190 IO depths : 1=1.0%, 2=2.0%, 4=3.9%, 8=7.8%, 16=15.7%, 32=31.4%, >=64=38.2% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.190 issued rwts: total=102,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459327: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=3, BW=3399KiB/s (3481kB/s)(34.0MiB/10242msec) 00:26:19.190 slat (usec): min=699, max=2107.1k, avg=299221.10, stdev=699516.80 00:26:19.190 clat (msec): min=67, max=10182, avg=6706.65, stdev=3196.33 00:26:19.190 lat (msec): min=2129, max=10241, avg=7005.88, stdev=3027.72 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 68], 5.00th=[ 2123], 10.00th=[ 2165], 20.00th=[ 2198], 00:26:19.190 | 30.00th=[ 4329], 40.00th=[ 6409], 50.00th=[ 6477], 60.00th=[ 8658], 00:26:19.190 | 70.00th=[ 8658], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:26:19.190 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.190 | 99.99th=[10134] 00:26:19.190 lat (msec) : 100=2.94%, >=2000=97.06% 00:26:19.190 cpu : usr=0.00%, sys=0.23%, ctx=89, majf=0, minf=8705 00:26:19.190 IO depths : 1=2.9%, 2=5.9%, 4=11.8%, 8=23.5%, 16=47.1%, 32=8.8%, >=64=0.0% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.190 issued rwts: total=34,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459328: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=138, BW=138MiB/s (145MB/s)(1400MiB/10114msec) 00:26:19.190 slat (usec): min=45, max=2148.5k, avg=7142.06, stdev=73999.10 00:26:19.190 clat (msec): min=111, max=3975, avg=747.83, stdev=775.43 00:26:19.190 lat (msec): min=115, max=4682, avg=754.97, stdev=784.62 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 117], 5.00th=[ 153], 10.00th=[ 184], 20.00th=[ 241], 00:26:19.190 | 30.00th=[ 363], 40.00th=[ 485], 50.00th=[ 531], 60.00th=[ 634], 00:26:19.190 | 70.00th=[ 693], 80.00th=[ 885], 90.00th=[ 1586], 95.00th=[ 2433], 00:26:19.190 | 99.00th=[ 3910], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], 00:26:19.190 | 99.99th=[ 3977] 00:26:19.190 bw ( KiB/s): min=30720, max=663552, per=5.24%, avg=217204.42, stdev=165616.00, samples=12 00:26:19.190 iops : min= 30, max= 648, avg=212.00, stdev=161.78, samples=12 00:26:19.190 lat (msec) : 250=23.29%, 500=20.79%, 750=30.64%, 1000=9.14%, 2000=10.50% 00:26:19.190 lat (msec) : >=2000=5.64% 00:26:19.190 cpu : usr=0.00%, sys=1.37%, ctx=1419, majf=0, minf=32769 00:26:19.190 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.3%, >=64=95.5% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.190 issued rwts: total=1400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459329: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=42, BW=43.0MiB/s (45.1MB/s)(439MiB/10216msec) 00:26:19.190 slat (usec): min=48, max=2145.5k, avg=23168.12, stdev=156443.53 00:26:19.190 clat (msec): min=42, max=5158, avg=2333.85, stdev=1630.52 00:26:19.190 lat (msec): min=833, max=5159, avg=2357.02, stdev=1628.83 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 835], 5.00th=[ 852], 10.00th=[ 869], 20.00th=[ 902], 00:26:19.190 | 30.00th=[ 953], 40.00th=[ 1267], 50.00th=[ 1536], 60.00th=[ 1955], 00:26:19.190 | 70.00th=[ 3373], 80.00th=[ 4530], 90.00th=[ 4866], 95.00th=[ 5000], 00:26:19.190 | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], 00:26:19.190 | 99.99th=[ 5134] 00:26:19.190 bw ( KiB/s): min= 2048, max=155648, per=2.20%, avg=90989.71, stdev=62162.31, samples=7 00:26:19.190 iops : min= 2, max= 152, avg=88.86, stdev=60.71, samples=7 00:26:19.190 lat (msec) : 50=0.23%, 1000=35.54%, 2000=24.83%, >=2000=39.41% 00:26:19.190 cpu : usr=0.00%, sys=0.80%, ctx=615, majf=0, minf=32769 00:26:19.190 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.3%, >=64=85.6% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.190 issued rwts: total=439,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459330: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=5, BW=5167KiB/s (5291kB/s)(52.0MiB/10306msec) 00:26:19.190 slat (usec): min=511, max=2096.7k, avg=196399.70, stdev=583930.98 00:26:19.190 clat (msec): min=92, max=10304, avg=7559.22, stdev=3317.23 00:26:19.190 lat (msec): min=2125, max=10305, avg=7755.62, stdev=3165.36 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 93], 5.00th=[ 2123], 10.00th=[ 2165], 20.00th=[ 4279], 00:26:19.190 | 30.00th=[ 6409], 40.00th=[ 6477], 50.00th=[10134], 60.00th=[10268], 00:26:19.190 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.190 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.190 | 99.99th=[10268] 00:26:19.190 lat (msec) : 100=1.92%, >=2000=98.08% 00:26:19.190 cpu : usr=0.00%, sys=0.35%, ctx=106, majf=0, minf=13313 00:26:19.190 IO depths : 1=1.9%, 2=3.8%, 4=7.7%, 8=15.4%, 16=30.8%, 32=40.4%, >=64=0.0% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.190 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.190 issued rwts: total=52,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.190 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.190 job2: (groupid=0, jobs=1): err= 0: pid=1459331: Tue Apr 23 21:27:11 2024 00:26:19.190 read: IOPS=5, BW=5661KiB/s (5797kB/s)(57.0MiB/10311msec) 00:26:19.190 slat (usec): min=757, max=2087.7k, avg=179505.25, stdev=561577.54 00:26:19.190 clat (msec): min=78, max=10309, avg=8570.07, stdev=2723.39 00:26:19.190 lat (msec): min=2160, max=10310, avg=8749.58, stdev=2480.02 00:26:19.190 clat percentiles (msec): 00:26:19.190 | 1.00th=[ 79], 5.00th=[ 2165], 10.00th=[ 4279], 20.00th=[ 6477], 00:26:19.190 | 30.00th=[ 8658], 40.00th=[10134], 50.00th=[10134], 60.00th=[10268], 00:26:19.190 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.190 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.190 | 99.99th=[10268] 00:26:19.190 lat (msec) : 100=1.75%, >=2000=98.25% 00:26:19.190 cpu : usr=0.00%, sys=0.37%, ctx=109, majf=0, minf=14593 00:26:19.190 IO depths : 1=1.8%, 2=3.5%, 4=7.0%, 8=14.0%, 16=28.1%, 32=45.6%, >=64=0.0% 00:26:19.190 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.191 issued rwts: total=57,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459332: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=75, BW=75.0MiB/s (78.7MB/s)(757MiB/10087msec) 00:26:19.191 slat (usec): min=35, max=2090.7k, avg=13206.66, stdev=85339.57 00:26:19.191 clat (msec): min=85, max=3523, avg=1412.25, stdev=974.02 00:26:19.191 lat (msec): min=103, max=3524, avg=1425.46, stdev=978.63 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 115], 5.00th=[ 489], 10.00th=[ 726], 20.00th=[ 818], 00:26:19.191 | 30.00th=[ 827], 40.00th=[ 844], 50.00th=[ 885], 60.00th=[ 1011], 00:26:19.191 | 70.00th=[ 1267], 80.00th=[ 2970], 90.00th=[ 3104], 95.00th=[ 3306], 00:26:19.191 | 99.00th=[ 3440], 99.50th=[ 3507], 99.90th=[ 3540], 99.95th=[ 3540], 00:26:19.191 | 99.99th=[ 3540] 00:26:19.191 bw ( KiB/s): min=18432, max=174080, per=2.83%, avg=117129.91, stdev=47651.79, samples=11 00:26:19.191 iops : min= 18, max= 170, avg=114.36, stdev=46.54, samples=11 00:26:19.191 lat (msec) : 100=0.13%, 250=1.98%, 500=3.04%, 750=5.55%, 1000=48.61% 00:26:19.191 lat (msec) : 2000=17.83%, >=2000=22.85% 00:26:19.191 cpu : usr=0.00%, sys=1.21%, ctx=1088, majf=0, minf=32769 00:26:19.191 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.7% 00:26:19.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.191 issued rwts: total=757,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459333: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=10, BW=10.9MiB/s (11.5MB/s)(111MiB/10153msec) 00:26:19.191 slat (usec): min=388, max=2116.2k, avg=91053.21, stdev=353990.80 00:26:19.191 clat (msec): min=45, max=10118, avg=7092.09, stdev=2449.86 00:26:19.191 lat (msec): min=2074, max=10152, avg=7183.15, stdev=2372.16 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 2072], 5.00th=[ 2089], 10.00th=[ 2106], 20.00th=[ 5671], 00:26:19.191 | 30.00th=[ 5873], 40.00th=[ 6141], 50.00th=[ 8154], 60.00th=[ 8288], 00:26:19.191 | 70.00th=[ 8490], 80.00th=[ 9866], 90.00th=[10000], 95.00th=[10000], 00:26:19.191 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.191 | 99.99th=[10134] 00:26:19.191 lat (msec) : 50=0.90%, >=2000=99.10% 00:26:19.191 cpu : usr=0.01%, sys=0.50%, ctx=268, majf=0, minf=28417 00:26:19.191 IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.2%, 16=14.4%, 32=28.8%, >=64=43.2% 00:26:19.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.191 issued rwts: total=111,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459334: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=16, BW=16.7MiB/s (17.5MB/s)(171MiB/10222msec) 00:26:19.191 slat (usec): min=331, max=2207.2k, avg=59526.38, stdev=266110.97 00:26:19.191 clat (msec): min=42, max=8311, avg=6126.25, stdev=1951.46 00:26:19.191 lat (msec): min=2031, max=8348, avg=6185.78, stdev=1884.76 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 2039], 5.00th=[ 2500], 10.00th=[ 2836], 20.00th=[ 3675], 00:26:19.191 | 30.00th=[ 5738], 40.00th=[ 6409], 50.00th=[ 6678], 60.00th=[ 7013], 00:26:19.191 | 70.00th=[ 7617], 80.00th=[ 7819], 90.00th=[ 8087], 95.00th=[ 8288], 00:26:19.191 | 99.00th=[ 8288], 99.50th=[ 8288], 99.90th=[ 8288], 99.95th=[ 8288], 00:26:19.191 | 99.99th=[ 8288] 00:26:19.191 bw ( KiB/s): min= 2048, max=49152, per=0.43%, avg=17612.80, stdev=19353.33, samples=5 00:26:19.191 iops : min= 2, max= 48, avg=17.20, stdev=18.90, samples=5 00:26:19.191 lat (msec) : 50=0.58%, >=2000=99.42% 00:26:19.191 cpu : usr=0.01%, sys=0.62%, ctx=446, majf=0, minf=32769 00:26:19.191 IO depths : 1=0.6%, 2=1.2%, 4=2.3%, 8=4.7%, 16=9.4%, 32=18.7%, >=64=63.2% 00:26:19.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=97.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.2% 00:26:19.191 issued rwts: total=171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459335: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=35, BW=35.3MiB/s (37.0MB/s)(362MiB/10263msec) 00:26:19.191 slat (usec): min=41, max=2054.4k, avg=28219.21, stdev=177571.60 00:26:19.191 clat (msec): min=45, max=3925, avg=3020.87, stdev=883.60 00:26:19.191 lat (msec): min=750, max=3927, avg=3049.09, stdev=857.86 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 751], 5.00th=[ 885], 10.00th=[ 1586], 20.00th=[ 2970], 00:26:19.191 | 30.00th=[ 3171], 40.00th=[ 3205], 50.00th=[ 3306], 60.00th=[ 3373], 00:26:19.191 | 70.00th=[ 3540], 80.00th=[ 3675], 90.00th=[ 3742], 95.00th=[ 3842], 00:26:19.191 | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], 00:26:19.191 | 99.99th=[ 3910] 00:26:19.191 bw ( KiB/s): min= 4096, max=158012, per=1.65%, avg=68472.29, stdev=61081.43, samples=7 00:26:19.191 iops : min= 4, max= 154, avg=66.71, stdev=59.47, samples=7 00:26:19.191 lat (msec) : 50=0.28%, 750=0.83%, 1000=6.08%, 2000=12.15%, >=2000=80.66% 00:26:19.191 cpu : usr=0.03%, sys=0.84%, ctx=600, majf=0, minf=32769 00:26:19.191 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.2%, 16=4.4%, 32=8.8%, >=64=82.6% 00:26:19.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.191 issued rwts: total=362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459336: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=77, BW=77.8MiB/s (81.5MB/s)(797MiB/10249msec) 00:26:19.191 slat (usec): min=39, max=2071.8k, avg=12739.51, stdev=101736.26 00:26:19.191 clat (msec): min=92, max=4183, avg=1539.98, stdev=1155.32 00:26:19.191 lat (msec): min=312, max=4189, avg=1552.72, stdev=1158.71 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 321], 5.00th=[ 351], 10.00th=[ 363], 20.00th=[ 485], 00:26:19.191 | 30.00th=[ 743], 40.00th=[ 810], 50.00th=[ 995], 60.00th=[ 1485], 00:26:19.191 | 70.00th=[ 2265], 80.00th=[ 2433], 90.00th=[ 3473], 95.00th=[ 3977], 00:26:19.191 | 99.00th=[ 4144], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], 00:26:19.191 | 99.99th=[ 4178] 00:26:19.191 bw ( KiB/s): min= 2043, max=374784, per=2.54%, avg=105376.77, stdev=101841.39, samples=13 00:26:19.191 iops : min= 1, max= 366, avg=102.77, stdev=99.54, samples=13 00:26:19.191 lat (msec) : 100=0.13%, 500=19.95%, 750=13.17%, 1000=16.81%, 2000=15.06% 00:26:19.191 lat (msec) : >=2000=34.88% 00:26:19.191 cpu : usr=0.00%, sys=0.97%, ctx=1039, majf=0, minf=32769 00:26:19.191 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.1% 00:26:19.191 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.191 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.191 issued rwts: total=797,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.191 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.191 job2: (groupid=0, jobs=1): err= 0: pid=1459337: Tue Apr 23 21:27:11 2024 00:26:19.191 read: IOPS=79, BW=79.9MiB/s (83.8MB/s)(819MiB/10249msec) 00:26:19.191 slat (usec): min=37, max=2115.9k, avg=12459.30, stdev=111877.08 00:26:19.191 clat (msec): min=42, max=7729, avg=1521.24, stdev=2284.61 00:26:19.191 lat (msec): min=224, max=7730, avg=1533.70, stdev=2293.27 00:26:19.191 clat percentiles (msec): 00:26:19.191 | 1.00th=[ 230], 5.00th=[ 236], 10.00th=[ 239], 20.00th=[ 264], 00:26:19.191 | 30.00th=[ 326], 40.00th=[ 393], 50.00th=[ 447], 60.00th=[ 617], 00:26:19.191 | 70.00th=[ 718], 80.00th=[ 1653], 90.00th=[ 6477], 95.00th=[ 7148], 00:26:19.191 | 99.00th=[ 7752], 99.50th=[ 7752], 99.90th=[ 7752], 99.95th=[ 7752], 00:26:19.191 | 99.99th=[ 7752] 00:26:19.192 bw ( KiB/s): min= 2048, max=485376, per=3.11%, avg=128666.18, stdev=147302.21, samples=11 00:26:19.192 iops : min= 2, max= 474, avg=125.64, stdev=143.85, samples=11 00:26:19.192 lat (msec) : 50=0.12%, 250=12.33%, 500=41.76%, 750=16.73%, 1000=2.93% 00:26:19.192 lat (msec) : 2000=7.94%, >=2000=18.19% 00:26:19.192 cpu : usr=0.01%, sys=0.98%, ctx=950, majf=0, minf=32769 00:26:19.192 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=3.9%, >=64=92.3% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.192 issued rwts: total=819,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job2: (groupid=0, jobs=1): err= 0: pid=1459338: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=3, BW=3803KiB/s (3894kB/s)(38.0MiB/10232msec) 00:26:19.192 slat (usec): min=677, max=2108.6k, avg=267403.84, stdev=677929.75 00:26:19.192 clat (msec): min=69, max=10229, avg=7094.91, stdev=3188.60 00:26:19.192 lat (msec): min=2134, max=10231, avg=7362.31, stdev=3004.29 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 70], 5.00th=[ 2140], 10.00th=[ 2165], 20.00th=[ 4279], 00:26:19.192 | 30.00th=[ 4329], 40.00th=[ 6477], 50.00th=[ 6477], 60.00th=[ 8658], 00:26:19.192 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.192 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.192 | 99.99th=[10268] 00:26:19.192 lat (msec) : 100=2.63%, >=2000=97.37% 00:26:19.192 cpu : usr=0.00%, sys=0.29%, ctx=65, majf=0, minf=9729 00:26:19.192 IO depths : 1=2.6%, 2=5.3%, 4=10.5%, 8=21.1%, 16=42.1%, 32=18.4%, >=64=0.0% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.192 issued rwts: total=38,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459342: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=37, BW=37.7MiB/s (39.6MB/s)(386MiB/10228msec) 00:26:19.192 slat (usec): min=452, max=2028.2k, avg=26254.36, stdev=135945.53 00:26:19.192 clat (msec): min=91, max=4728, avg=2573.44, stdev=1003.10 00:26:19.192 lat (msec): min=1515, max=4741, avg=2599.69, stdev=994.64 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 1502], 5.00th=[ 1552], 10.00th=[ 1620], 20.00th=[ 1804], 00:26:19.192 | 30.00th=[ 1905], 40.00th=[ 2022], 50.00th=[ 2056], 60.00th=[ 2089], 00:26:19.192 | 70.00th=[ 3339], 80.00th=[ 3775], 90.00th=[ 4144], 95.00th=[ 4463], 00:26:19.192 | 99.00th=[ 4665], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], 00:26:19.192 | 99.99th=[ 4732] 00:26:19.192 bw ( KiB/s): min= 4096, max=98304, per=1.28%, avg=52826.10, stdev=31544.07, samples=10 00:26:19.192 iops : min= 4, max= 96, avg=51.50, stdev=30.78, samples=10 00:26:19.192 lat (msec) : 100=0.26%, 2000=35.75%, >=2000=63.99% 00:26:19.192 cpu : usr=0.03%, sys=0.77%, ctx=850, majf=0, minf=32769 00:26:19.192 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.1%, 16=4.1%, 32=8.3%, >=64=83.7% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.192 issued rwts: total=386,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459343: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=81, BW=81.2MiB/s (85.1MB/s)(814MiB/10025msec) 00:26:19.192 slat (usec): min=45, max=1470.3k, avg=12282.47, stdev=52877.22 00:26:19.192 clat (msec): min=24, max=3659, avg=1165.87, stdev=540.11 00:26:19.192 lat (msec): min=26, max=3671, avg=1178.16, stdev=549.07 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 53], 5.00th=[ 393], 10.00th=[ 575], 20.00th=[ 743], 00:26:19.192 | 30.00th=[ 844], 40.00th=[ 902], 50.00th=[ 1011], 60.00th=[ 1418], 00:26:19.192 | 70.00th=[ 1519], 80.00th=[ 1703], 90.00th=[ 1854], 95.00th=[ 2039], 00:26:19.192 | 99.00th=[ 2165], 99.50th=[ 2198], 99.90th=[ 3675], 99.95th=[ 3675], 00:26:19.192 | 99.99th=[ 3675] 00:26:19.192 bw ( KiB/s): min=47009, max=217088, per=2.65%, avg=109730.75, stdev=54198.20, samples=12 00:26:19.192 iops : min= 45, max= 212, avg=107.08, stdev=53.02, samples=12 00:26:19.192 lat (msec) : 50=0.98%, 100=1.35%, 250=1.60%, 500=2.09%, 750=14.86% 00:26:19.192 lat (msec) : 1000=28.26%, 2000=45.09%, >=2000=5.77% 00:26:19.192 cpu : usr=0.01%, sys=1.00%, ctx=1488, majf=0, minf=32769 00:26:19.192 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=3.9%, >=64=92.3% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.192 issued rwts: total=814,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459344: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=12, BW=12.8MiB/s (13.4MB/s)(131MiB/10251msec) 00:26:19.192 slat (usec): min=360, max=2079.9k, avg=77717.08, stdev=338892.87 00:26:19.192 clat (msec): min=69, max=10245, avg=5635.64, stdev=3668.37 00:26:19.192 lat (msec): min=1339, max=10246, avg=5713.36, stdev=3657.36 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 1334], 5.00th=[ 1351], 10.00th=[ 1552], 20.00th=[ 1754], 00:26:19.192 | 30.00th=[ 1955], 40.00th=[ 2165], 50.00th=[ 6409], 60.00th=[ 8356], 00:26:19.192 | 70.00th=[ 8658], 80.00th=[10134], 90.00th=[10268], 95.00th=[10268], 00:26:19.192 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.192 | 99.99th=[10268] 00:26:19.192 bw ( KiB/s): min= 6144, max= 6144, per=0.15%, avg=6144.00, stdev= 0.00, samples=1 00:26:19.192 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 00:26:19.192 lat (msec) : 100=0.76%, 2000=33.59%, >=2000=65.65% 00:26:19.192 cpu : usr=0.00%, sys=0.68%, ctx=244, majf=0, minf=32769 00:26:19.192 IO depths : 1=0.8%, 2=1.5%, 4=3.1%, 8=6.1%, 16=12.2%, 32=24.4%, >=64=51.9% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=80.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=20.0% 00:26:19.192 issued rwts: total=131,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459345: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=10, BW=10.4MiB/s (10.9MB/s)(106MiB/10220msec) 00:26:19.192 slat (usec): min=654, max=2092.6k, avg=95543.93, stdev=377363.64 00:26:19.192 clat (msec): min=91, max=10196, avg=5600.41, stdev=2873.41 00:26:19.192 lat (msec): min=2123, max=10219, avg=5695.96, stdev=2856.83 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 2123], 5.00th=[ 2165], 10.00th=[ 3306], 20.00th=[ 3507], 00:26:19.192 | 30.00th=[ 3708], 40.00th=[ 3876], 50.00th=[ 4044], 60.00th=[ 4279], 00:26:19.192 | 70.00th=[ 8557], 80.00th=[10000], 90.00th=[10134], 95.00th=[10134], 00:26:19.192 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.192 | 99.99th=[10134] 00:26:19.192 lat (msec) : 100=0.94%, >=2000=99.06% 00:26:19.192 cpu : usr=0.00%, sys=0.53%, ctx=223, majf=0, minf=27137 00:26:19.192 IO depths : 1=0.9%, 2=1.9%, 4=3.8%, 8=7.5%, 16=15.1%, 32=30.2%, >=64=40.6% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.192 issued rwts: total=106,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459346: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=30, BW=30.5MiB/s (31.9MB/s)(306MiB/10049msec) 00:26:19.192 slat (usec): min=51, max=2135.5k, avg=32678.24, stdev=189045.32 00:26:19.192 clat (msec): min=48, max=7937, avg=1685.84, stdev=1595.40 00:26:19.192 lat (msec): min=49, max=7953, avg=1718.52, stdev=1643.02 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 53], 5.00th=[ 110], 10.00th=[ 169], 20.00th=[ 288], 00:26:19.192 | 30.00th=[ 667], 40.00th=[ 1234], 50.00th=[ 1536], 60.00th=[ 2005], 00:26:19.192 | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2232], 95.00th=[ 6007], 00:26:19.192 | 99.00th=[ 7886], 99.50th=[ 7953], 99.90th=[ 7953], 99.95th=[ 7953], 00:26:19.192 | 99.99th=[ 7953] 00:26:19.192 bw ( KiB/s): min=10240, max=172032, per=1.77%, avg=73318.40, stdev=59698.41, samples=5 00:26:19.192 iops : min= 10, max= 168, avg=71.60, stdev=58.30, samples=5 00:26:19.192 lat (msec) : 50=0.65%, 100=2.61%, 250=15.36%, 500=8.82%, 750=3.27% 00:26:19.192 lat (msec) : 1000=5.23%, 2000=23.53%, >=2000=40.52% 00:26:19.192 cpu : usr=0.00%, sys=0.72%, ctx=695, majf=0, minf=32769 00:26:19.192 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.6%, 16=5.2%, 32=10.5%, >=64=79.4% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:26:19.192 issued rwts: total=306,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459347: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=4, BW=4303KiB/s (4406kB/s)(43.0MiB/10233msec) 00:26:19.192 slat (usec): min=375, max=2081.0k, avg=235654.68, stdev=629557.86 00:26:19.192 clat (msec): min=99, max=10183, avg=6736.62, stdev=3190.72 00:26:19.192 lat (msec): min=2126, max=10232, avg=6972.28, stdev=3060.38 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 100], 5.00th=[ 2140], 10.00th=[ 2165], 20.00th=[ 4279], 00:26:19.192 | 30.00th=[ 4329], 40.00th=[ 6409], 50.00th=[ 6477], 60.00th=[ 8658], 00:26:19.192 | 70.00th=[10000], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:26:19.192 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.192 | 99.99th=[10134] 00:26:19.192 lat (msec) : 100=2.33%, >=2000=97.67% 00:26:19.192 cpu : usr=0.00%, sys=0.22%, ctx=82, majf=0, minf=11009 00:26:19.192 IO depths : 1=2.3%, 2=4.7%, 4=9.3%, 8=18.6%, 16=37.2%, 32=27.9%, >=64=0.0% 00:26:19.192 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.192 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.192 issued rwts: total=43,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.192 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.192 job3: (groupid=0, jobs=1): err= 0: pid=1459349: Tue Apr 23 21:27:11 2024 00:26:19.192 read: IOPS=25, BW=25.5MiB/s (26.8MB/s)(257MiB/10069msec) 00:26:19.192 slat (usec): min=483, max=2129.2k, avg=38965.77, stdev=206639.35 00:26:19.192 clat (msec): min=53, max=7930, avg=1515.03, stdev=830.74 00:26:19.192 lat (msec): min=90, max=8043, avg=1553.99, stdev=923.99 00:26:19.192 clat percentiles (msec): 00:26:19.192 | 1.00th=[ 94], 5.00th=[ 197], 10.00th=[ 342], 20.00th=[ 852], 00:26:19.192 | 30.00th=[ 1469], 40.00th=[ 1569], 50.00th=[ 1687], 60.00th=[ 1754], 00:26:19.193 | 70.00th=[ 1821], 80.00th=[ 1905], 90.00th=[ 1955], 95.00th=[ 2089], 00:26:19.193 | 99.00th=[ 4329], 99.50th=[ 6409], 99.90th=[ 7953], 99.95th=[ 7953], 00:26:19.193 | 99.99th=[ 7953] 00:26:19.193 bw ( KiB/s): min=49152, max=86016, per=1.59%, avg=65976.50, stdev=16212.29, samples=4 00:26:19.193 iops : min= 48, max= 84, avg=64.25, stdev=15.76, samples=4 00:26:19.193 lat (msec) : 100=1.17%, 250=6.23%, 500=5.45%, 750=5.45%, 1000=3.50% 00:26:19.193 lat (msec) : 2000=71.98%, >=2000=6.23% 00:26:19.193 cpu : usr=0.01%, sys=0.65%, ctx=707, majf=0, minf=32769 00:26:19.193 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=12.5%, >=64=75.5% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:26:19.193 issued rwts: total=257,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459350: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=36, BW=36.7MiB/s (38.5MB/s)(369MiB/10048msec) 00:26:19.193 slat (usec): min=48, max=2090.6k, avg=27198.34, stdev=170947.51 00:26:19.193 clat (msec): min=10, max=7411, avg=1322.13, stdev=1046.38 00:26:19.193 lat (msec): min=83, max=7423, avg=1349.33, stdev=1094.50 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 89], 5.00th=[ 192], 10.00th=[ 296], 20.00th=[ 510], 00:26:19.193 | 30.00th=[ 802], 40.00th=[ 911], 50.00th=[ 1418], 60.00th=[ 1653], 00:26:19.193 | 70.00th=[ 1703], 80.00th=[ 1770], 90.00th=[ 1871], 95.00th=[ 1921], 00:26:19.193 | 99.00th=[ 7349], 99.50th=[ 7416], 99.90th=[ 7416], 99.95th=[ 7416], 00:26:19.193 | 99.99th=[ 7416] 00:26:19.193 bw ( KiB/s): min=20480, max=139264, per=1.63%, avg=67584.00, stdev=43541.08, samples=5 00:26:19.193 iops : min= 20, max= 136, avg=66.00, stdev=42.52, samples=5 00:26:19.193 lat (msec) : 20=0.27%, 100=2.98%, 250=5.15%, 500=8.94%, 750=11.92% 00:26:19.193 lat (msec) : 1000=11.92%, 2000=55.01%, >=2000=3.79% 00:26:19.193 cpu : usr=0.00%, sys=0.83%, ctx=724, majf=0, minf=32769 00:26:19.193 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.2%, 16=4.3%, 32=8.7%, >=64=82.9% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.193 issued rwts: total=369,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459351: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=52, BW=52.8MiB/s (55.3MB/s)(531MiB/10064msec) 00:26:19.193 slat (usec): min=31, max=2092.1k, avg=18875.37, stdev=138938.20 00:26:19.193 clat (msec): min=39, max=6645, avg=2113.63, stdev=2183.86 00:26:19.193 lat (msec): min=72, max=6655, avg=2132.50, stdev=2190.60 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 88], 5.00th=[ 207], 10.00th=[ 326], 20.00th=[ 609], 00:26:19.193 | 30.00th=[ 969], 40.00th=[ 1083], 50.00th=[ 1234], 60.00th=[ 1519], 00:26:19.193 | 70.00th=[ 1737], 80.00th=[ 3272], 90.00th=[ 6544], 95.00th=[ 6611], 00:26:19.193 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6678], 99.95th=[ 6678], 00:26:19.193 | 99.99th=[ 6678] 00:26:19.193 bw ( KiB/s): min=38912, max=200704, per=2.49%, avg=103121.88, stdev=50972.77, samples=8 00:26:19.193 iops : min= 38, max= 196, avg=100.50, stdev=49.84, samples=8 00:26:19.193 lat (msec) : 50=0.19%, 100=1.69%, 250=4.52%, 500=10.55%, 750=7.91% 00:26:19.193 lat (msec) : 1000=6.59%, 2000=47.83%, >=2000=20.72% 00:26:19.193 cpu : usr=0.00%, sys=1.05%, ctx=828, majf=0, minf=32769 00:26:19.193 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.1% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.193 issued rwts: total=531,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459352: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=20, BW=20.2MiB/s (21.1MB/s)(204MiB/10115msec) 00:26:19.193 slat (usec): min=621, max=2101.7k, avg=49034.64, stdev=229417.48 00:26:19.193 clat (msec): min=111, max=8730, avg=2252.37, stdev=2077.31 00:26:19.193 lat (msec): min=117, max=8741, avg=2301.41, stdev=2124.55 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 126], 5.00th=[ 236], 10.00th=[ 409], 20.00th=[ 818], 00:26:19.193 | 30.00th=[ 1234], 40.00th=[ 1552], 50.00th=[ 1821], 60.00th=[ 2232], 00:26:19.193 | 70.00th=[ 2333], 80.00th=[ 2400], 90.00th=[ 5134], 95.00th=[ 8658], 00:26:19.193 | 99.00th=[ 8658], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:26:19.193 | 99.99th=[ 8792] 00:26:19.193 bw ( KiB/s): min=47104, max=61440, per=1.27%, avg=52565.33, stdev=7753.60, samples=3 00:26:19.193 iops : min= 46, max= 60, avg=51.33, stdev= 7.57, samples=3 00:26:19.193 lat (msec) : 250=5.88%, 500=6.37%, 750=6.37%, 1000=5.88%, 2000=30.39% 00:26:19.193 lat (msec) : >=2000=45.10% 00:26:19.193 cpu : usr=0.00%, sys=0.73%, ctx=690, majf=0, minf=32769 00:26:19.193 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=3.9%, 16=7.8%, 32=15.7%, >=64=69.1% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=98.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.3% 00:26:19.193 issued rwts: total=204,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459353: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=5, BW=5188KiB/s (5313kB/s)(52.0MiB/10263msec) 00:26:19.193 slat (usec): min=750, max=2086.8k, avg=195518.86, stdev=579136.69 00:26:19.193 clat (msec): min=95, max=10262, avg=7804.97, stdev=3117.74 00:26:19.193 lat (msec): min=2123, max=10262, avg=8000.48, stdev=2938.45 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 96], 5.00th=[ 2140], 10.00th=[ 2198], 20.00th=[ 4329], 00:26:19.193 | 30.00th=[ 6477], 40.00th=[ 8557], 50.00th=[10000], 60.00th=[10134], 00:26:19.193 | 70.00th=[10134], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.193 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.193 | 99.99th=[10268] 00:26:19.193 lat (msec) : 100=1.92%, >=2000=98.08% 00:26:19.193 cpu : usr=0.00%, sys=0.36%, ctx=92, majf=0, minf=13313 00:26:19.193 IO depths : 1=1.9%, 2=3.8%, 4=7.7%, 8=15.4%, 16=30.8%, 32=40.4%, >=64=0.0% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.193 issued rwts: total=52,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459354: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=8, BW=8930KiB/s (9145kB/s)(90.0MiB/10320msec) 00:26:19.193 slat (usec): min=396, max=2099.8k, avg=113600.02, stdev=449758.39 00:26:19.193 clat (msec): min=94, max=10317, avg=8220.56, stdev=2784.83 00:26:19.193 lat (msec): min=2131, max=10319, avg=8334.16, stdev=2655.16 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 95], 5.00th=[ 2198], 10.00th=[ 4279], 20.00th=[ 6409], 00:26:19.193 | 30.00th=[ 6477], 40.00th=[ 8658], 50.00th=[10134], 60.00th=[10268], 00:26:19.193 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.193 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.193 | 99.99th=[10268] 00:26:19.193 lat (msec) : 100=1.11%, >=2000=98.89% 00:26:19.193 cpu : usr=0.00%, sys=0.53%, ctx=113, majf=0, minf=23041 00:26:19.193 IO depths : 1=1.1%, 2=2.2%, 4=4.4%, 8=8.9%, 16=17.8%, 32=35.6%, >=64=30.0% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.193 issued rwts: total=90,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job3: (groupid=0, jobs=1): err= 0: pid=1459356: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=4, BW=4866KiB/s (4983kB/s)(49.0MiB/10312msec) 00:26:19.193 slat (usec): min=699, max=2112.0k, avg=208509.38, stdev=600594.71 00:26:19.193 clat (msec): min=94, max=10310, avg=8036.17, stdev=3334.10 00:26:19.193 lat (msec): min=2125, max=10311, avg=8244.68, stdev=3141.00 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 95], 5.00th=[ 2140], 10.00th=[ 2165], 20.00th=[ 4329], 00:26:19.193 | 30.00th=[ 6477], 40.00th=[10134], 50.00th=[10268], 60.00th=[10268], 00:26:19.193 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:26:19.193 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.193 | 99.99th=[10268] 00:26:19.193 lat (msec) : 100=2.04%, >=2000=97.96% 00:26:19.193 cpu : usr=0.00%, sys=0.35%, ctx=107, majf=0, minf=12545 00:26:19.193 IO depths : 1=2.0%, 2=4.1%, 4=8.2%, 8=16.3%, 16=32.7%, 32=36.7%, >=64=0.0% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:19.193 issued rwts: total=49,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job4: (groupid=0, jobs=1): err= 0: pid=1459359: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=105, BW=106MiB/s (111MB/s)(1062MiB/10048msec) 00:26:19.193 slat (usec): min=37, max=2183.0k, avg=9433.16, stdev=93208.03 00:26:19.193 clat (msec): min=27, max=6140, avg=1077.89, stdev=1646.50 00:26:19.193 lat (msec): min=52, max=6141, avg=1087.33, stdev=1654.38 00:26:19.193 clat percentiles (msec): 00:26:19.193 | 1.00th=[ 65], 5.00th=[ 194], 10.00th=[ 334], 20.00th=[ 363], 00:26:19.193 | 30.00th=[ 384], 40.00th=[ 397], 50.00th=[ 498], 60.00th=[ 550], 00:26:19.193 | 70.00th=[ 684], 80.00th=[ 793], 90.00th=[ 5269], 95.00th=[ 5671], 00:26:19.193 | 99.00th=[ 6074], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], 00:26:19.193 | 99.99th=[ 6141] 00:26:19.193 bw ( KiB/s): min=145408, max=359728, per=5.77%, avg=238962.88, stdev=82556.27, samples=8 00:26:19.193 iops : min= 142, max= 351, avg=233.25, stdev=80.60, samples=8 00:26:19.193 lat (msec) : 50=0.09%, 100=1.79%, 250=5.56%, 500=45.95%, 750=25.14% 00:26:19.193 lat (msec) : 1000=9.89%, >=2000=11.58% 00:26:19.193 cpu : usr=0.02%, sys=1.13%, ctx=1530, majf=0, minf=32769 00:26:19.193 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.0%, >=64=94.1% 00:26:19.193 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.193 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.193 issued rwts: total=1062,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.193 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.193 job4: (groupid=0, jobs=1): err= 0: pid=1459360: Tue Apr 23 21:27:11 2024 00:26:19.193 read: IOPS=10, BW=10.6MiB/s (11.1MB/s)(109MiB/10260msec) 00:26:19.193 slat (usec): min=1095, max=2127.4k, avg=93243.42, stdev=391748.20 00:26:19.193 clat (msec): min=95, max=10255, avg=3592.23, stdev=3125.44 00:26:19.194 lat (msec): min=1721, max=10259, avg=3685.47, stdev=3171.42 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 1720], 5.00th=[ 1737], 10.00th=[ 1754], 20.00th=[ 1821], 00:26:19.194 | 30.00th=[ 1871], 40.00th=[ 1905], 50.00th=[ 1955], 60.00th=[ 2022], 00:26:19.194 | 70.00th=[ 2106], 80.00th=[ 6409], 90.00th=[10000], 95.00th=[10134], 00:26:19.194 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:26:19.194 | 99.99th=[10268] 00:26:19.194 lat (msec) : 100=0.92%, 2000=53.21%, >=2000=45.87% 00:26:19.194 cpu : usr=0.00%, sys=0.45%, ctx=284, majf=0, minf=27905 00:26:19.194 IO depths : 1=0.9%, 2=1.8%, 4=3.7%, 8=7.3%, 16=14.7%, 32=29.4%, >=64=42.2% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:19.194 issued rwts: total=109,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459361: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=197, BW=198MiB/s (207MB/s)(1985MiB/10032msec) 00:26:19.194 slat (usec): min=29, max=2089.4k, avg=5036.39, stdev=71658.18 00:26:19.194 clat (msec): min=31, max=3985, avg=472.45, stdev=790.30 00:26:19.194 lat (msec): min=31, max=3986, avg=477.49, stdev=796.78 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 99], 5.00th=[ 117], 10.00th=[ 118], 20.00th=[ 118], 00:26:19.194 | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 174], 60.00th=[ 230], 00:26:19.194 | 70.00th=[ 245], 80.00th=[ 464], 90.00th=[ 1133], 95.00th=[ 2567], 00:26:19.194 | 99.00th=[ 3809], 99.50th=[ 3943], 99.90th=[ 3977], 99.95th=[ 3977], 00:26:19.194 | 99.99th=[ 3977] 00:26:19.194 bw ( KiB/s): min=10240, max=1069056, per=9.57%, avg=396174.22, stdev=369874.00, samples=9 00:26:19.194 iops : min= 10, max= 1044, avg=386.89, stdev=361.21, samples=9 00:26:19.194 lat (msec) : 50=0.30%, 100=0.76%, 250=71.18%, 500=9.62%, 750=3.93% 00:26:19.194 lat (msec) : 1000=2.17%, 2000=3.43%, >=2000=8.61% 00:26:19.194 cpu : usr=0.00%, sys=1.32%, ctx=2029, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.8%, 32=1.6%, >=64=96.8% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.194 issued rwts: total=1985,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459362: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=2, BW=2307KiB/s (2363kB/s)(23.0MiB/10208msec) 00:26:19.194 slat (msec): min=5, max=2101, avg=439.54, stdev=821.30 00:26:19.194 clat (msec): min=97, max=10107, avg=5870.68, stdev=2625.18 00:26:19.194 lat (msec): min=2127, max=10207, avg=6310.22, stdev=2455.54 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 99], 5.00th=[ 2123], 10.00th=[ 2140], 20.00th=[ 4279], 00:26:19.194 | 30.00th=[ 4329], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 6477], 00:26:19.194 | 70.00th=[ 8557], 80.00th=[ 8557], 90.00th=[ 8658], 95.00th=[ 8658], 00:26:19.194 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:19.194 | 99.99th=[10134] 00:26:19.194 lat (msec) : 100=4.35%, >=2000=95.65% 00:26:19.194 cpu : usr=0.00%, sys=0.14%, ctx=74, majf=0, minf=5889 00:26:19.194 IO depths : 1=4.3%, 2=8.7%, 4=17.4%, 8=34.8%, 16=34.8%, 32=0.0%, >=64=0.0% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:19.194 issued rwts: total=23,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459363: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=20, BW=20.2MiB/s (21.2MB/s)(207MiB/10261msec) 00:26:19.194 slat (usec): min=493, max=2078.4k, avg=49094.76, stdev=260201.68 00:26:19.194 clat (msec): min=97, max=8623, avg=5170.88, stdev=2626.77 00:26:19.194 lat (msec): min=970, max=10099, avg=5219.98, stdev=2620.47 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 969], 5.00th=[ 1011], 10.00th=[ 1821], 20.00th=[ 2005], 00:26:19.194 | 30.00th=[ 2567], 40.00th=[ 4396], 50.00th=[ 6275], 60.00th=[ 6409], 00:26:19.194 | 70.00th=[ 7550], 80.00th=[ 7752], 90.00th=[ 7886], 95.00th=[ 7953], 00:26:19.194 | 99.00th=[ 8020], 99.50th=[ 8557], 99.90th=[ 8658], 99.95th=[ 8658], 00:26:19.194 | 99.99th=[ 8658] 00:26:19.194 bw ( KiB/s): min= 2048, max=77824, per=0.78%, avg=32358.40, stdev=35513.76, samples=5 00:26:19.194 iops : min= 2, max= 76, avg=31.60, stdev=34.68, samples=5 00:26:19.194 lat (msec) : 100=0.48%, 1000=4.35%, 2000=13.53%, >=2000=81.64% 00:26:19.194 cpu : usr=0.01%, sys=0.70%, ctx=398, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.5%, 2=1.0%, 4=1.9%, 8=3.9%, 16=7.7%, 32=15.5%, >=64=69.6% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.2% 00:26:19.194 issued rwts: total=207,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459364: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=121, BW=121MiB/s (127MB/s)(1215MiB/10033msec) 00:26:19.194 slat (usec): min=33, max=2055.3k, avg=8237.60, stdev=72071.00 00:26:19.194 clat (msec): min=20, max=3091, avg=845.87, stdev=748.84 00:26:19.194 lat (msec): min=39, max=3096, avg=854.11, stdev=752.67 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 75], 5.00th=[ 268], 10.00th=[ 472], 20.00th=[ 502], 00:26:19.194 | 30.00th=[ 510], 40.00th=[ 523], 50.00th=[ 550], 60.00th=[ 634], 00:26:19.194 | 70.00th=[ 743], 80.00th=[ 860], 90.00th=[ 2769], 95.00th=[ 2970], 00:26:19.194 | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3104], 99.95th=[ 3104], 00:26:19.194 | 99.99th=[ 3104] 00:26:19.194 bw ( KiB/s): min= 8192, max=266240, per=3.97%, avg=164522.67, stdev=80119.06, samples=12 00:26:19.194 iops : min= 8, max= 260, avg=160.67, stdev=78.24, samples=12 00:26:19.194 lat (msec) : 50=0.33%, 100=0.99%, 250=2.88%, 500=12.51%, 750=53.99% 00:26:19.194 lat (msec) : 1000=14.32%, 2000=4.20%, >=2000=10.78% 00:26:19.194 cpu : usr=0.06%, sys=1.41%, ctx=2066, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.6%, >=64=94.8% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.194 issued rwts: total=1215,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459365: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=80, BW=80.9MiB/s (84.9MB/s)(815MiB/10070msec) 00:26:19.194 slat (usec): min=33, max=2145.2k, avg=12278.32, stdev=105076.11 00:26:19.194 clat (msec): min=61, max=6008, avg=1377.92, stdev=1684.95 00:26:19.194 lat (msec): min=105, max=6021, avg=1390.19, stdev=1692.09 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 127], 5.00th=[ 430], 10.00th=[ 502], 20.00th=[ 527], 00:26:19.194 | 30.00th=[ 575], 40.00th=[ 642], 50.00th=[ 726], 60.00th=[ 818], 00:26:19.194 | 70.00th=[ 936], 80.00th=[ 1011], 90.00th=[ 5201], 95.00th=[ 5604], 00:26:19.194 | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 6007], 99.95th=[ 6007], 00:26:19.194 | 99.99th=[ 6007] 00:26:19.194 bw ( KiB/s): min=94208, max=247808, per=4.25%, avg=176010.12, stdev=56724.01, samples=8 00:26:19.194 iops : min= 92, max= 242, avg=171.88, stdev=55.41, samples=8 00:26:19.194 lat (msec) : 100=0.12%, 250=2.94%, 500=6.50%, 750=44.54%, 1000=24.17% 00:26:19.194 lat (msec) : 2000=6.99%, >=2000=14.72% 00:26:19.194 cpu : usr=0.00%, sys=1.05%, ctx=1832, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=3.9%, >=64=92.3% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.194 issued rwts: total=815,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459366: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=20, BW=20.9MiB/s (21.9MB/s)(213MiB/10212msec) 00:26:19.194 slat (usec): min=386, max=2148.5k, avg=47480.17, stdev=259020.85 00:26:19.194 clat (msec): min=97, max=8648, avg=5442.01, stdev=2660.40 00:26:19.194 lat (msec): min=1644, max=9820, avg=5489.49, stdev=2648.37 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 1653], 5.00th=[ 1754], 10.00th=[ 2140], 20.00th=[ 2299], 00:26:19.194 | 30.00th=[ 2567], 40.00th=[ 4212], 50.00th=[ 6946], 60.00th=[ 7215], 00:26:19.194 | 70.00th=[ 7684], 80.00th=[ 7886], 90.00th=[ 8288], 95.00th=[ 8423], 00:26:19.194 | 99.00th=[ 8658], 99.50th=[ 8658], 99.90th=[ 8658], 99.95th=[ 8658], 00:26:19.194 | 99.99th=[ 8658] 00:26:19.194 bw ( KiB/s): min= 2043, max=63488, per=0.60%, avg=24867.86, stdev=26923.11, samples=7 00:26:19.194 iops : min= 1, max= 62, avg=24.14, stdev=26.44, samples=7 00:26:19.194 lat (msec) : 100=0.47%, 2000=7.04%, >=2000=92.49% 00:26:19.194 cpu : usr=0.01%, sys=0.71%, ctx=316, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.5%, 2=0.9%, 4=1.9%, 8=3.8%, 16=7.5%, 32=15.0%, >=64=70.4% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.1% 00:26:19.194 issued rwts: total=213,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.194 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.194 job4: (groupid=0, jobs=1): err= 0: pid=1459367: Tue Apr 23 21:27:11 2024 00:26:19.194 read: IOPS=95, BW=95.3MiB/s (99.9MB/s)(958MiB/10052msec) 00:26:19.194 slat (usec): min=31, max=2092.4k, avg=10436.40, stdev=105218.64 00:26:19.194 clat (msec): min=51, max=4127, avg=852.95, stdev=960.02 00:26:19.194 lat (msec): min=77, max=4129, avg=863.39, stdev=969.42 00:26:19.194 clat percentiles (msec): 00:26:19.194 | 1.00th=[ 148], 5.00th=[ 351], 10.00th=[ 355], 20.00th=[ 368], 00:26:19.194 | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 384], 60.00th=[ 393], 00:26:19.194 | 70.00th=[ 481], 80.00th=[ 1200], 90.00th=[ 2769], 95.00th=[ 3306], 00:26:19.194 | 99.00th=[ 3440], 99.50th=[ 4111], 99.90th=[ 4144], 99.95th=[ 4144], 00:26:19.194 | 99.99th=[ 4144] 00:26:19.194 bw ( KiB/s): min=32768, max=366592, per=4.70%, avg=194509.25, stdev=134317.76, samples=8 00:26:19.194 iops : min= 32, max= 358, avg=189.75, stdev=131.33, samples=8 00:26:19.194 lat (msec) : 100=0.84%, 250=1.67%, 500=69.31%, 750=3.13%, 1000=2.92% 00:26:19.194 lat (msec) : 2000=7.52%, >=2000=14.61% 00:26:19.194 cpu : usr=0.01%, sys=1.04%, ctx=1079, majf=0, minf=32769 00:26:19.194 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.3%, >=64=93.4% 00:26:19.194 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.194 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.194 issued rwts: total=958,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job4: (groupid=0, jobs=1): err= 0: pid=1459368: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=149, BW=150MiB/s (157MB/s)(1517MiB/10136msec) 00:26:19.195 slat (usec): min=43, max=103315, avg=6598.55, stdev=14000.80 00:26:19.195 clat (msec): min=119, max=1469, avg=817.45, stdev=258.91 00:26:19.195 lat (msec): min=150, max=1497, avg=824.05, stdev=259.51 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 397], 5.00th=[ 430], 10.00th=[ 477], 20.00th=[ 558], 00:26:19.195 | 30.00th=[ 651], 40.00th=[ 735], 50.00th=[ 818], 60.00th=[ 894], 00:26:19.195 | 70.00th=[ 953], 80.00th=[ 1028], 90.00th=[ 1133], 95.00th=[ 1301], 00:26:19.195 | 99.00th=[ 1435], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], 00:26:19.195 | 99.99th=[ 1469] 00:26:19.195 bw ( KiB/s): min=36864, max=305152, per=3.61%, avg=149682.95, stdev=70900.58, samples=19 00:26:19.195 iops : min= 36, max= 298, avg=146.00, stdev=69.29, samples=19 00:26:19.195 lat (msec) : 250=0.40%, 500=12.72%, 750=30.45%, 1000=32.30%, 2000=24.13% 00:26:19.195 cpu : usr=0.05%, sys=1.90%, ctx=2054, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.1%, 32=2.1%, >=64=95.8% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.195 issued rwts: total=1517,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job4: (groupid=0, jobs=1): err= 0: pid=1459369: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=38, BW=38.9MiB/s (40.8MB/s)(397MiB/10214msec) 00:26:19.195 slat (usec): min=127, max=2183.0k, avg=25570.79, stdev=179153.19 00:26:19.195 clat (msec): min=60, max=6011, avg=3042.54, stdev=1964.55 00:26:19.195 lat (msec): min=791, max=6017, avg=3068.11, stdev=1963.05 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 793], 5.00th=[ 810], 10.00th=[ 902], 20.00th=[ 1099], 00:26:19.195 | 30.00th=[ 1250], 40.00th=[ 2265], 50.00th=[ 2500], 60.00th=[ 2735], 00:26:19.195 | 70.00th=[ 5604], 80.00th=[ 5738], 90.00th=[ 5873], 95.00th=[ 5940], 00:26:19.195 | 99.00th=[ 5940], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], 00:26:19.195 | 99.99th=[ 6007] 00:26:19.195 bw ( KiB/s): min= 4096, max=182272, per=1.66%, avg=68864.00, stdev=66551.56, samples=8 00:26:19.195 iops : min= 4, max= 178, avg=67.25, stdev=64.99, samples=8 00:26:19.195 lat (msec) : 100=0.25%, 1000=15.11%, 2000=19.40%, >=2000=65.24% 00:26:19.195 cpu : usr=0.00%, sys=0.76%, ctx=1054, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=8.1%, >=64=84.1% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.195 issued rwts: total=397,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job4: (groupid=0, jobs=1): err= 0: pid=1459370: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=34, BW=34.9MiB/s (36.6MB/s)(357MiB/10239msec) 00:26:19.195 slat (usec): min=415, max=3367.4k, avg=28409.75, stdev=238052.29 00:26:19.195 clat (msec): min=95, max=6444, avg=1706.66, stdev=1558.02 00:26:19.195 lat (msec): min=480, max=6471, avg=1735.07, stdev=1575.76 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 485], 20.00th=[ 498], 00:26:19.195 | 30.00th=[ 506], 40.00th=[ 510], 50.00th=[ 542], 60.00th=[ 2735], 00:26:19.195 | 70.00th=[ 3004], 80.00th=[ 3171], 90.00th=[ 3306], 95.00th=[ 3373], 00:26:19.195 | 99.00th=[ 6275], 99.50th=[ 6409], 99.90th=[ 6477], 99.95th=[ 6477], 00:26:19.195 | 99.99th=[ 6477] 00:26:19.195 bw ( KiB/s): min= 4096, max=264192, per=2.83%, avg=117338.25, stdev=126189.68, samples=4 00:26:19.195 iops : min= 4, max= 258, avg=114.50, stdev=123.17, samples=4 00:26:19.195 lat (msec) : 100=0.28%, 500=22.41%, 750=35.57%, 2000=0.56%, >=2000=41.18% 00:26:19.195 cpu : usr=0.00%, sys=0.60%, ctx=847, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.2%, 16=4.5%, 32=9.0%, >=64=82.4% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:19.195 issued rwts: total=357,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job4: (groupid=0, jobs=1): err= 0: pid=1459371: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=168, BW=168MiB/s (176MB/s)(1716MiB/10198msec) 00:26:19.195 slat (usec): min=28, max=2108.5k, avg=5904.45, stdev=62847.07 00:26:19.195 clat (msec): min=62, max=3260, avg=612.13, stdev=753.89 00:26:19.195 lat (msec): min=112, max=3263, avg=618.04, stdev=759.37 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 114], 20.00th=[ 114], 00:26:19.195 | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 236], 60.00th=[ 393], 00:26:19.195 | 70.00th=[ 676], 80.00th=[ 986], 90.00th=[ 1888], 95.00th=[ 2433], 00:26:19.195 | 99.00th=[ 3138], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3272], 00:26:19.195 | 99.99th=[ 3272] 00:26:19.195 bw ( KiB/s): min=12288, max=991232, per=7.14%, avg=295656.73, stdev=342680.37, samples=11 00:26:19.195 iops : min= 12, max= 968, avg=288.73, stdev=334.65, samples=11 00:26:19.195 lat (msec) : 100=0.06%, 250=55.01%, 500=8.51%, 750=9.44%, 1000=7.58% 00:26:19.195 lat (msec) : 2000=10.84%, >=2000=8.57% 00:26:19.195 cpu : usr=0.03%, sys=1.21%, ctx=1983, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.5%, 16=0.9%, 32=1.9%, >=64=96.3% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.195 issued rwts: total=1716,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job5: (groupid=0, jobs=1): err= 0: pid=1459372: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=73, BW=73.8MiB/s (77.4MB/s)(740MiB/10026msec) 00:26:19.195 slat (usec): min=28, max=2112.9k, avg=13519.80, stdev=93468.90 00:26:19.195 clat (msec): min=18, max=3316, avg=1393.39, stdev=946.79 00:26:19.195 lat (msec): min=29, max=3320, avg=1406.91, stdev=950.47 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 77], 5.00th=[ 523], 10.00th=[ 651], 20.00th=[ 793], 00:26:19.195 | 30.00th=[ 844], 40.00th=[ 919], 50.00th=[ 1003], 60.00th=[ 1083], 00:26:19.195 | 70.00th=[ 1301], 80.00th=[ 1620], 90.00th=[ 3239], 95.00th=[ 3272], 00:26:19.195 | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], 00:26:19.195 | 99.99th=[ 3306] 00:26:19.195 bw ( KiB/s): min= 8192, max=202752, per=2.75%, avg=114014.18, stdev=52511.12, samples=11 00:26:19.195 iops : min= 8, max= 198, avg=111.27, stdev=51.34, samples=11 00:26:19.195 lat (msec) : 20=0.14%, 50=0.41%, 100=0.68%, 250=1.08%, 500=2.43% 00:26:19.195 lat (msec) : 750=12.03%, 1000=32.84%, 2000=30.54%, >=2000=19.86% 00:26:19.195 cpu : usr=0.00%, sys=1.04%, ctx=1947, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.2%, 32=4.3%, >=64=91.5% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.195 issued rwts: total=740,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job5: (groupid=0, jobs=1): err= 0: pid=1459373: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=77, BW=77.9MiB/s (81.6MB/s)(781MiB/10031msec) 00:26:19.195 slat (usec): min=28, max=2097.8k, avg=12816.90, stdev=113824.92 00:26:19.195 clat (msec): min=18, max=5472, avg=1432.13, stdev=1628.31 00:26:19.195 lat (msec): min=31, max=5485, avg=1444.95, stdev=1634.31 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 126], 5.00th=[ 388], 10.00th=[ 439], 20.00th=[ 498], 00:26:19.195 | 30.00th=[ 527], 40.00th=[ 575], 50.00th=[ 617], 60.00th=[ 667], 00:26:19.195 | 70.00th=[ 885], 80.00th=[ 2056], 90.00th=[ 5134], 95.00th=[ 5336], 00:26:19.195 | 99.00th=[ 5470], 99.50th=[ 5470], 99.90th=[ 5470], 99.95th=[ 5470], 00:26:19.195 | 99.99th=[ 5470] 00:26:19.195 bw ( KiB/s): min=20480, max=307200, per=3.23%, avg=133612.80, stdev=97447.88, samples=10 00:26:19.195 iops : min= 20, max= 300, avg=130.40, stdev=95.16, samples=10 00:26:19.195 lat (msec) : 20=0.13%, 50=0.26%, 100=0.38%, 250=1.02%, 500=21.13% 00:26:19.195 lat (msec) : 750=44.30%, 1000=5.63%, 2000=7.04%, >=2000=20.10% 00:26:19.195 cpu : usr=0.02%, sys=0.98%, ctx=1058, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.1%, >=64=91.9% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.195 issued rwts: total=781,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job5: (groupid=0, jobs=1): err= 0: pid=1459374: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=130, BW=131MiB/s (137MB/s)(1312MiB/10050msec) 00:26:19.195 slat (usec): min=40, max=2155.2k, avg=7625.71, stdev=60215.79 00:26:19.195 clat (msec): min=41, max=3385, avg=886.75, stdev=770.05 00:26:19.195 lat (msec): min=63, max=3481, avg=894.38, stdev=773.44 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 81], 5.00th=[ 120], 10.00th=[ 122], 20.00th=[ 259], 00:26:19.195 | 30.00th=[ 363], 40.00th=[ 388], 50.00th=[ 456], 60.00th=[ 567], 00:26:19.195 | 70.00th=[ 1385], 80.00th=[ 1569], 90.00th=[ 2022], 95.00th=[ 2500], 00:26:19.195 | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 3373], 00:26:19.195 | 99.99th=[ 3373] 00:26:19.195 bw ( KiB/s): min=59273, max=632832, per=4.51%, avg=186664.46, stdev=172792.49, samples=13 00:26:19.195 iops : min= 57, max= 618, avg=182.15, stdev=168.85, samples=13 00:26:19.195 lat (msec) : 50=0.08%, 100=1.14%, 250=18.06%, 500=32.55%, 750=8.99% 00:26:19.195 lat (msec) : 1000=1.14%, 2000=27.44%, >=2000=10.59% 00:26:19.195 cpu : usr=0.01%, sys=1.34%, ctx=2503, majf=0, minf=32769 00:26:19.195 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.4%, >=64=95.2% 00:26:19.195 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.195 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.195 issued rwts: total=1312,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.195 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.195 job5: (groupid=0, jobs=1): err= 0: pid=1459375: Tue Apr 23 21:27:11 2024 00:26:19.195 read: IOPS=88, BW=89.0MiB/s (93.3MB/s)(899MiB/10105msec) 00:26:19.195 slat (usec): min=39, max=2080.0k, avg=11122.50, stdev=71484.95 00:26:19.195 clat (msec): min=101, max=3786, avg=1324.72, stdev=948.23 00:26:19.195 lat (msec): min=136, max=3792, avg=1335.84, stdev=951.28 00:26:19.195 clat percentiles (msec): 00:26:19.195 | 1.00th=[ 157], 5.00th=[ 368], 10.00th=[ 667], 20.00th=[ 818], 00:26:19.195 | 30.00th=[ 860], 40.00th=[ 894], 50.00th=[ 953], 60.00th=[ 1133], 00:26:19.195 | 70.00th=[ 1217], 80.00th=[ 1385], 90.00th=[ 3574], 95.00th=[ 3675], 00:26:19.196 | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3775], 99.95th=[ 3775], 00:26:19.196 | 99.99th=[ 3775] 00:26:19.196 bw ( KiB/s): min=10240, max=163840, per=2.54%, avg=105361.47, stdev=54624.53, samples=15 00:26:19.196 iops : min= 10, max= 160, avg=102.80, stdev=53.25, samples=15 00:26:19.196 lat (msec) : 250=2.34%, 500=4.34%, 750=3.67%, 1000=41.49%, 2000=34.04% 00:26:19.196 lat (msec) : >=2000=14.13% 00:26:19.196 cpu : usr=0.04%, sys=1.21%, ctx=1376, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=93.0% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.196 issued rwts: total=899,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459376: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=56, BW=56.8MiB/s (59.5MB/s)(571MiB/10058msec) 00:26:19.196 slat (usec): min=42, max=2102.4k, avg=17521.71, stdev=115779.35 00:26:19.196 clat (msec): min=50, max=4806, avg=1957.06, stdev=1604.96 00:26:19.196 lat (msec): min=68, max=4809, avg=1974.58, stdev=1609.42 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 80], 5.00th=[ 186], 10.00th=[ 292], 20.00th=[ 609], 00:26:19.196 | 30.00th=[ 810], 40.00th=[ 936], 50.00th=[ 1250], 60.00th=[ 1670], 00:26:19.196 | 70.00th=[ 3104], 80.00th=[ 3306], 90.00th=[ 4732], 95.00th=[ 4799], 00:26:19.196 | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], 00:26:19.196 | 99.99th=[ 4799] 00:26:19.196 bw ( KiB/s): min= 6144, max=215261, per=2.19%, avg=90543.70, stdev=63538.38, samples=10 00:26:19.196 iops : min= 6, max= 210, avg=88.40, stdev=62.00, samples=10 00:26:19.196 lat (msec) : 100=1.75%, 250=6.13%, 500=9.98%, 750=9.63%, 1000=17.86% 00:26:19.196 lat (msec) : 2000=18.56%, >=2000=36.08% 00:26:19.196 cpu : usr=0.03%, sys=1.02%, ctx=1096, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.6%, >=64=89.0% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.196 issued rwts: total=571,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459377: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=52, BW=52.4MiB/s (55.0MB/s)(527MiB/10055msec) 00:26:19.196 slat (usec): min=58, max=2139.7k, avg=18993.50, stdev=106697.85 00:26:19.196 clat (msec): min=43, max=3921, avg=2050.26, stdev=1201.07 00:26:19.196 lat (msec): min=60, max=3930, avg=2069.25, stdev=1203.30 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 114], 5.00th=[ 372], 10.00th=[ 802], 20.00th=[ 961], 00:26:19.196 | 30.00th=[ 1150], 40.00th=[ 1401], 50.00th=[ 1670], 60.00th=[ 2056], 00:26:19.196 | 70.00th=[ 3239], 80.00th=[ 3540], 90.00th=[ 3842], 95.00th=[ 3876], 00:26:19.196 | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], 00:26:19.196 | 99.99th=[ 3910] 00:26:19.196 bw ( KiB/s): min=26624, max=153293, per=1.97%, avg=81648.80, stdev=38342.40, samples=10 00:26:19.196 iops : min= 26, max= 149, avg=79.50, stdev=37.27, samples=10 00:26:19.196 lat (msec) : 50=0.19%, 100=0.57%, 250=2.66%, 500=2.66%, 750=3.23% 00:26:19.196 lat (msec) : 1000=14.42%, 2000=35.10%, >=2000=41.18% 00:26:19.196 cpu : usr=0.01%, sys=1.07%, ctx=1626, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.1%, >=64=88.0% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.196 issued rwts: total=527,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459378: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=61, BW=61.8MiB/s (64.8MB/s)(619MiB/10015msec) 00:26:19.196 slat (usec): min=102, max=2087.0k, avg=16153.22, stdev=131567.98 00:26:19.196 clat (msec): min=14, max=6530, avg=1074.32, stdev=1168.37 00:26:19.196 lat (msec): min=15, max=6547, avg=1090.47, stdev=1188.29 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 21], 5.00th=[ 148], 10.00th=[ 506], 20.00th=[ 542], 00:26:19.196 | 30.00th=[ 609], 40.00th=[ 659], 50.00th=[ 701], 60.00th=[ 869], 00:26:19.196 | 70.00th=[ 1083], 80.00th=[ 1284], 90.00th=[ 1536], 95.00th=[ 5000], 00:26:19.196 | 99.00th=[ 6544], 99.50th=[ 6544], 99.90th=[ 6544], 99.95th=[ 6544], 00:26:19.196 | 99.99th=[ 6544] 00:26:19.196 bw ( KiB/s): min=14336, max=229376, per=3.11%, avg=128984.14, stdev=85591.94, samples=7 00:26:19.196 iops : min= 14, max= 224, avg=125.71, stdev=83.79, samples=7 00:26:19.196 lat (msec) : 20=0.97%, 50=2.75%, 100=0.65%, 250=1.29%, 500=2.91% 00:26:19.196 lat (msec) : 750=47.50%, 1000=9.21%, 2000=28.92%, >=2000=5.82% 00:26:19.196 cpu : usr=0.00%, sys=0.89%, ctx=1548, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.8% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.196 issued rwts: total=619,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459379: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=57, BW=57.9MiB/s (60.7MB/s)(583MiB/10069msec) 00:26:19.196 slat (usec): min=40, max=2166.9k, avg=17162.67, stdev=107311.89 00:26:19.196 clat (msec): min=60, max=4886, avg=1796.10, stdev=1410.77 00:26:19.196 lat (msec): min=83, max=4902, avg=1813.27, stdev=1417.37 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 118], 5.00th=[ 292], 10.00th=[ 426], 20.00th=[ 609], 00:26:19.196 | 30.00th=[ 718], 40.00th=[ 894], 50.00th=[ 1200], 60.00th=[ 1653], 00:26:19.196 | 70.00th=[ 2400], 80.00th=[ 3574], 90.00th=[ 4010], 95.00th=[ 4732], 00:26:19.196 | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:26:19.196 | 99.99th=[ 4866] 00:26:19.196 bw ( KiB/s): min=34816, max=188416, per=2.05%, avg=84875.09, stdev=53243.96, samples=11 00:26:19.196 iops : min= 34, max= 184, avg=82.82, stdev=51.93, samples=11 00:26:19.196 lat (msec) : 100=0.69%, 250=3.09%, 500=9.26%, 750=17.50%, 1000=12.01% 00:26:19.196 lat (msec) : 2000=19.73%, >=2000=37.74% 00:26:19.196 cpu : usr=0.00%, sys=0.96%, ctx=1538, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.5%, >=64=89.2% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.196 issued rwts: total=583,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459380: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=74, BW=74.5MiB/s (78.1MB/s)(751MiB/10078msec) 00:26:19.196 slat (usec): min=37, max=2086.3k, avg=13332.75, stdev=88877.28 00:26:19.196 clat (msec): min=61, max=4471, avg=1584.88, stdev=1030.13 00:26:19.196 lat (msec): min=88, max=4489, avg=1598.21, stdev=1035.60 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 103], 5.00th=[ 226], 10.00th=[ 485], 20.00th=[ 860], 00:26:19.196 | 30.00th=[ 944], 40.00th=[ 1250], 50.00th=[ 1318], 60.00th=[ 1435], 00:26:19.196 | 70.00th=[ 2022], 80.00th=[ 2198], 90.00th=[ 3339], 95.00th=[ 3406], 00:26:19.196 | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], 00:26:19.196 | 99.99th=[ 4463] 00:26:19.196 bw ( KiB/s): min= 6144, max=174080, per=2.37%, avg=98128.85, stdev=47293.31, samples=13 00:26:19.196 iops : min= 6, max= 170, avg=95.77, stdev=46.16, samples=13 00:26:19.196 lat (msec) : 100=0.67%, 250=5.59%, 500=4.13%, 750=4.13%, 1000=22.37% 00:26:19.196 lat (msec) : 2000=32.22%, >=2000=30.89% 00:26:19.196 cpu : usr=0.01%, sys=1.25%, ctx=1265, majf=0, minf=32769 00:26:19.196 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.3%, >=64=91.6% 00:26:19.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.196 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.196 issued rwts: total=751,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.196 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.196 job5: (groupid=0, jobs=1): err= 0: pid=1459381: Tue Apr 23 21:27:11 2024 00:26:19.196 read: IOPS=50, BW=50.2MiB/s (52.6MB/s)(504MiB/10045msec) 00:26:19.196 slat (usec): min=47, max=2230.9k, avg=19869.57, stdev=130153.27 00:26:19.196 clat (msec): min=28, max=6282, avg=2367.77, stdev=1942.39 00:26:19.196 lat (msec): min=46, max=6294, avg=2387.64, stdev=1948.20 00:26:19.196 clat percentiles (msec): 00:26:19.196 | 1.00th=[ 77], 5.00th=[ 300], 10.00th=[ 584], 20.00th=[ 961], 00:26:19.196 | 30.00th=[ 1028], 40.00th=[ 1150], 50.00th=[ 1452], 60.00th=[ 2056], 00:26:19.196 | 70.00th=[ 2265], 80.00th=[ 5269], 90.00th=[ 5738], 95.00th=[ 5873], 00:26:19.196 | 99.00th=[ 6141], 99.50th=[ 6275], 99.90th=[ 6275], 99.95th=[ 6275], 00:26:19.197 | 99.99th=[ 6275] 00:26:19.197 bw ( KiB/s): min= 4096, max=161792, per=1.55%, avg=64161.08, stdev=43299.78, samples=12 00:26:19.197 iops : min= 4, max= 158, avg=62.58, stdev=42.30, samples=12 00:26:19.197 lat (msec) : 50=0.40%, 100=0.99%, 250=2.78%, 500=4.56%, 750=3.97% 00:26:19.197 lat (msec) : 1000=13.10%, 2000=33.53%, >=2000=40.67% 00:26:19.197 cpu : usr=0.01%, sys=1.01%, ctx=1554, majf=0, minf=32769 00:26:19.197 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.3%, >=64=87.5% 00:26:19.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.197 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:19.197 issued rwts: total=504,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.197 job5: (groupid=0, jobs=1): err= 0: pid=1459382: Tue Apr 23 21:27:11 2024 00:26:19.197 read: IOPS=71, BW=71.2MiB/s (74.7MB/s)(718MiB/10078msec) 00:26:19.197 slat (usec): min=471, max=2044.6k, avg=13946.14, stdev=76720.23 00:26:19.197 clat (msec): min=62, max=3346, avg=1649.86, stdev=799.27 00:26:19.197 lat (msec): min=98, max=3353, avg=1663.80, stdev=799.81 00:26:19.197 clat percentiles (msec): 00:26:19.197 | 1.00th=[ 271], 5.00th=[ 751], 10.00th=[ 953], 20.00th=[ 1133], 00:26:19.197 | 30.00th=[ 1250], 40.00th=[ 1318], 50.00th=[ 1401], 60.00th=[ 1485], 00:26:19.197 | 70.00th=[ 1670], 80.00th=[ 1838], 90.00th=[ 3239], 95.00th=[ 3272], 00:26:19.197 | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3339], 99.95th=[ 3339], 00:26:19.197 | 99.99th=[ 3339] 00:26:19.197 bw ( KiB/s): min= 8175, max=141029, per=1.94%, avg=80504.60, stdev=38663.33, samples=15 00:26:19.197 iops : min= 7, max= 137, avg=78.33, stdev=37.86, samples=15 00:26:19.197 lat (msec) : 100=0.28%, 250=0.70%, 500=1.67%, 750=2.23%, 1000=8.36% 00:26:19.197 lat (msec) : 2000=69.08%, >=2000=17.69% 00:26:19.197 cpu : usr=0.00%, sys=1.26%, ctx=2249, majf=0, minf=32769 00:26:19.197 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:26:19.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.197 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:19.197 issued rwts: total=718,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.197 job5: (groupid=0, jobs=1): err= 0: pid=1459383: Tue Apr 23 21:27:11 2024 00:26:19.197 read: IOPS=96, BW=96.7MiB/s (101MB/s)(970MiB/10031msec) 00:26:19.197 slat (usec): min=56, max=1438.7k, avg=10305.84, stdev=47570.02 00:26:19.197 clat (msec): min=30, max=3653, avg=1050.90, stdev=694.94 00:26:19.197 lat (msec): min=40, max=3664, avg=1061.21, stdev=702.38 00:26:19.197 clat percentiles (msec): 00:26:19.197 | 1.00th=[ 53], 5.00th=[ 224], 10.00th=[ 481], 20.00th=[ 617], 00:26:19.197 | 30.00th=[ 617], 40.00th=[ 634], 50.00th=[ 743], 60.00th=[ 995], 00:26:19.197 | 70.00th=[ 1167], 80.00th=[ 1502], 90.00th=[ 2198], 95.00th=[ 2299], 00:26:19.197 | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3641], 99.95th=[ 3641], 00:26:19.197 | 99.99th=[ 3641] 00:26:19.197 bw ( KiB/s): min=14336, max=215040, per=2.98%, avg=123310.93, stdev=72989.03, samples=14 00:26:19.197 iops : min= 14, max= 210, avg=120.36, stdev=71.34, samples=14 00:26:19.197 lat (msec) : 50=0.82%, 100=1.13%, 250=3.92%, 500=4.23%, 750=40.10% 00:26:19.197 lat (msec) : 1000=10.10%, 2000=24.85%, >=2000=14.85% 00:26:19.197 cpu : usr=0.06%, sys=1.23%, ctx=1522, majf=0, minf=32769 00:26:19.197 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.5% 00:26:19.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.197 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.197 issued rwts: total=970,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.197 job5: (groupid=0, jobs=1): err= 0: pid=1459384: Tue Apr 23 21:27:11 2024 00:26:19.197 read: IOPS=91, BW=91.2MiB/s (95.6MB/s)(916MiB/10045msec) 00:26:19.197 slat (usec): min=355, max=2105.9k, avg=10920.25, stdev=83934.94 00:26:19.197 clat (msec): min=39, max=2932, avg=1122.38, stdev=798.53 00:26:19.197 lat (msec): min=52, max=2936, avg=1133.30, stdev=802.39 00:26:19.197 clat percentiles (msec): 00:26:19.197 | 1.00th=[ 146], 5.00th=[ 439], 10.00th=[ 523], 20.00th=[ 584], 00:26:19.197 | 30.00th=[ 659], 40.00th=[ 701], 50.00th=[ 852], 60.00th=[ 986], 00:26:19.197 | 70.00th=[ 1083], 80.00th=[ 1284], 90.00th=[ 2869], 95.00th=[ 2903], 00:26:19.197 | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2937], 99.95th=[ 2937], 00:26:19.197 | 99.99th=[ 2937] 00:26:19.197 bw ( KiB/s): min=16384, max=249856, per=3.25%, avg=134621.92, stdev=66896.73, samples=12 00:26:19.197 iops : min= 16, max= 244, avg=131.42, stdev=65.27, samples=12 00:26:19.197 lat (msec) : 50=0.11%, 100=0.33%, 250=1.64%, 500=4.04%, 750=39.52% 00:26:19.197 lat (msec) : 1000=17.79%, 2000=20.74%, >=2000=15.83% 00:26:19.197 cpu : usr=0.03%, sys=1.01%, ctx=2009, majf=0, minf=32769 00:26:19.197 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.1% 00:26:19.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:19.197 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:19.197 issued rwts: total=916,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:19.197 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:19.197 00:26:19.197 Run status group 0 (all jobs): 00:26:19.197 READ: bw=4045MiB/s (4241MB/s), 2287KiB/s-198MiB/s (2342kB/s-207MB/s), io=40.8GiB (43.8GB), run=10015-10323msec 00:26:19.197 00:26:19.197 Disk stats (read/write): 00:26:19.197 nvme0n1: ios=54894/0, merge=0/0, ticks=6588393/0, in_queue=6588393, util=98.54% 00:26:19.197 nvme1n1: ios=45890/0, merge=0/0, ticks=6453768/0, in_queue=6453768, util=98.76% 00:26:19.197 nvme2n1: ios=40365/0, merge=0/0, ticks=6444907/0, in_queue=6444907, util=98.74% 00:26:19.197 nvme3n1: ios=25854/0, merge=0/0, ticks=7063470/0, in_queue=7063470, util=98.89% 00:26:19.197 nvme4n1: ios=83755/0, merge=0/0, ticks=6819285/0, in_queue=6819285, util=99.02% 00:26:19.197 nvme5n1: ios=78556/0, merge=0/0, ticks=7315378/0, in_queue=7315378, util=99.15% 00:26:19.197 21:27:12 -- target/srq_overwhelm.sh@38 -- # sync 00:26:19.197 21:27:12 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:26:19.197 21:27:12 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:19.197 21:27:12 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:26:19.197 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:26:19.197 21:27:13 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:26:19.197 21:27:13 -- common/autotest_common.sh@1205 -- # local i=0 00:26:19.197 21:27:13 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:19.197 21:27:13 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:26:19.197 21:27:13 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:19.197 21:27:13 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:26:19.197 21:27:13 -- common/autotest_common.sh@1217 -- # return 0 00:26:19.197 21:27:13 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:26:19.197 21:27:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:19.197 21:27:13 -- common/autotest_common.sh@10 -- # set +x 00:26:19.197 21:27:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:19.197 21:27:13 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:19.197 21:27:13 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:26:20.132 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:26:20.132 21:27:14 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:26:20.132 21:27:14 -- common/autotest_common.sh@1205 -- # local i=0 00:26:20.132 21:27:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:20.132 21:27:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:26:20.132 21:27:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:20.132 21:27:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:26:20.132 21:27:14 -- common/autotest_common.sh@1217 -- # return 0 00:26:20.132 21:27:14 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:20.132 21:27:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.132 21:27:14 -- common/autotest_common.sh@10 -- # set +x 00:26:20.132 21:27:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.132 21:27:14 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:20.132 21:27:14 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:26:21.067 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:26:21.067 21:27:15 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:26:21.067 21:27:15 -- common/autotest_common.sh@1205 -- # local i=0 00:26:21.067 21:27:15 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:21.067 21:27:15 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:26:21.067 21:27:15 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:26:21.067 21:27:15 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:21.067 21:27:15 -- common/autotest_common.sh@1217 -- # return 0 00:26:21.067 21:27:15 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:21.067 21:27:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.067 21:27:15 -- common/autotest_common.sh@10 -- # set +x 00:26:21.067 21:27:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.067 21:27:15 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:21.067 21:27:15 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:26:22.003 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:26:22.003 21:27:16 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:26:22.003 21:27:16 -- common/autotest_common.sh@1205 -- # local i=0 00:26:22.003 21:27:16 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:22.003 21:27:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:26:22.003 21:27:16 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:22.003 21:27:16 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:26:22.003 21:27:16 -- common/autotest_common.sh@1217 -- # return 0 00:26:22.003 21:27:16 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:26:22.003 21:27:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.003 21:27:16 -- common/autotest_common.sh@10 -- # set +x 00:26:22.003 21:27:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.003 21:27:16 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:22.003 21:27:16 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:26:22.938 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:26:22.938 21:27:17 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:26:22.938 21:27:17 -- common/autotest_common.sh@1205 -- # local i=0 00:26:22.938 21:27:17 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:22.938 21:27:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:26:22.938 21:27:17 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:22.938 21:27:17 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:26:22.938 21:27:17 -- common/autotest_common.sh@1217 -- # return 0 00:26:22.938 21:27:17 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:26:22.938 21:27:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.938 21:27:17 -- common/autotest_common.sh@10 -- # set +x 00:26:22.938 21:27:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.938 21:27:17 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:22.938 21:27:17 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:26:23.873 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:26:23.873 21:27:18 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:26:23.873 21:27:18 -- common/autotest_common.sh@1205 -- # local i=0 00:26:23.873 21:27:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:23.873 21:27:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:26:23.873 21:27:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:23.873 21:27:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:26:23.873 21:27:18 -- common/autotest_common.sh@1217 -- # return 0 00:26:23.873 21:27:18 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:26:23.873 21:27:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.873 21:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:23.873 21:27:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.873 21:27:18 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:26:23.873 21:27:18 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:26:23.873 21:27:18 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:23.873 21:27:18 -- nvmf/common.sh@117 -- # sync 00:26:23.873 21:27:18 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:23.873 21:27:18 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:23.873 21:27:18 -- nvmf/common.sh@120 -- # set +e 00:26:23.873 21:27:18 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:23.873 21:27:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:23.873 rmmod nvme_rdma 00:26:23.873 rmmod nvme_fabrics 00:26:23.873 21:27:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:23.873 21:27:18 -- nvmf/common.sh@124 -- # set -e 00:26:23.873 21:27:18 -- nvmf/common.sh@125 -- # return 0 00:26:23.873 21:27:18 -- nvmf/common.sh@478 -- # '[' -n 1457475 ']' 00:26:23.873 21:27:18 -- nvmf/common.sh@479 -- # killprocess 1457475 00:26:23.873 21:27:18 -- common/autotest_common.sh@936 -- # '[' -z 1457475 ']' 00:26:23.873 21:27:18 -- common/autotest_common.sh@940 -- # kill -0 1457475 00:26:23.873 21:27:18 -- common/autotest_common.sh@941 -- # uname 00:26:23.873 21:27:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:23.873 21:27:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1457475 00:26:24.132 21:27:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:24.132 21:27:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:24.132 21:27:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1457475' 00:26:24.132 killing process with pid 1457475 00:26:24.132 21:27:18 -- common/autotest_common.sh@955 -- # kill 1457475 00:26:24.132 21:27:18 -- common/autotest_common.sh@960 -- # wait 1457475 00:26:24.132 [2024-04-23 21:27:18.221451] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:24.391 21:27:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:24.391 21:27:18 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:24.391 00:26:24.391 real 0m29.486s 00:26:24.391 user 1m46.423s 00:26:24.391 sys 0m12.550s 00:26:24.391 21:27:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:24.391 21:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.391 ************************************ 00:26:24.391 END TEST nvmf_srq_overwhelm 00:26:24.391 ************************************ 00:26:24.391 21:27:18 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:24.391 21:27:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:24.391 21:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:24.391 21:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.650 ************************************ 00:26:24.650 START TEST nvmf_shutdown 00:26:24.650 ************************************ 00:26:24.650 21:27:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:24.650 * Looking for test storage... 00:26:24.650 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:26:24.650 21:27:18 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:24.650 21:27:18 -- nvmf/common.sh@7 -- # uname -s 00:26:24.650 21:27:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:24.650 21:27:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:24.650 21:27:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:24.650 21:27:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:24.650 21:27:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:24.650 21:27:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:24.650 21:27:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:24.650 21:27:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:24.650 21:27:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:24.650 21:27:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:24.650 21:27:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:24.650 21:27:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:24.651 21:27:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:24.651 21:27:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:24.651 21:27:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:24.651 21:27:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:24.651 21:27:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:24.651 21:27:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:24.651 21:27:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:24.651 21:27:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:24.651 21:27:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.651 21:27:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.651 21:27:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.651 21:27:18 -- paths/export.sh@5 -- # export PATH 00:26:24.651 21:27:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:24.651 21:27:18 -- nvmf/common.sh@47 -- # : 0 00:26:24.651 21:27:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:24.651 21:27:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:24.651 21:27:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:24.651 21:27:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:24.651 21:27:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:24.651 21:27:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:24.651 21:27:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:24.651 21:27:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:24.651 21:27:18 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:24.651 21:27:18 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:24.651 21:27:18 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:26:24.651 21:27:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:24.651 21:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:24.651 21:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.910 ************************************ 00:26:24.910 START TEST nvmf_shutdown_tc1 00:26:24.910 ************************************ 00:26:24.910 21:27:18 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:26:24.910 21:27:18 -- target/shutdown.sh@74 -- # starttarget 00:26:24.910 21:27:18 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:24.910 21:27:18 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:24.910 21:27:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:24.910 21:27:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:24.910 21:27:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:24.910 21:27:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:24.910 21:27:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:24.910 21:27:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:24.910 21:27:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:24.910 21:27:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:24.910 21:27:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:24.910 21:27:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:24.910 21:27:18 -- common/autotest_common.sh@10 -- # set +x 00:26:30.182 21:27:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:30.182 21:27:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:30.182 21:27:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:30.182 21:27:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:30.182 21:27:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:30.182 21:27:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:30.182 21:27:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:30.182 21:27:24 -- nvmf/common.sh@295 -- # net_devs=() 00:26:30.182 21:27:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:30.182 21:27:24 -- nvmf/common.sh@296 -- # e810=() 00:26:30.182 21:27:24 -- nvmf/common.sh@296 -- # local -ga e810 00:26:30.182 21:27:24 -- nvmf/common.sh@297 -- # x722=() 00:26:30.182 21:27:24 -- nvmf/common.sh@297 -- # local -ga x722 00:26:30.182 21:27:24 -- nvmf/common.sh@298 -- # mlx=() 00:26:30.182 21:27:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:30.182 21:27:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:30.182 21:27:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:30.182 21:27:24 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:30.183 21:27:24 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:30.183 21:27:24 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:30.183 21:27:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:30.183 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:30.183 21:27:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:30.183 21:27:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:30.183 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:30.183 21:27:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:30.183 21:27:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.183 21:27:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.183 21:27:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:30.183 Found net devices under 0000:18:00.0: mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.183 21:27:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.183 21:27:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.183 21:27:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:30.183 Found net devices under 0000:18:00.1: mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.183 21:27:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:30.183 21:27:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:30.183 21:27:24 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:30.183 21:27:24 -- nvmf/common.sh@58 -- # uname 00:26:30.183 21:27:24 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:30.183 21:27:24 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:30.183 21:27:24 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:30.183 21:27:24 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:30.183 21:27:24 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:30.183 21:27:24 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:30.183 21:27:24 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:30.183 21:27:24 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:30.183 21:27:24 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:30.183 21:27:24 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:30.183 21:27:24 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:30.183 21:27:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:30.183 21:27:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:30.183 21:27:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:30.183 21:27:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:30.183 21:27:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@105 -- # continue 2 00:26:30.183 21:27:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@105 -- # continue 2 00:26:30.183 21:27:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:30.183 21:27:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:30.183 21:27:24 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:30.183 21:27:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:30.183 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:30.183 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:30.183 altname enp24s0f0np0 00:26:30.183 altname ens785f0np0 00:26:30.183 inet 192.168.100.8/24 scope global mlx_0_0 00:26:30.183 valid_lft forever preferred_lft forever 00:26:30.183 21:27:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:30.183 21:27:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:30.183 21:27:24 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:30.183 21:27:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:30.183 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:30.183 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:30.183 altname enp24s0f1np1 00:26:30.183 altname ens785f1np1 00:26:30.183 inet 192.168.100.9/24 scope global mlx_0_1 00:26:30.183 valid_lft forever preferred_lft forever 00:26:30.183 21:27:24 -- nvmf/common.sh@411 -- # return 0 00:26:30.183 21:27:24 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:30.183 21:27:24 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:30.183 21:27:24 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:30.183 21:27:24 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:30.183 21:27:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:30.183 21:27:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:30.183 21:27:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:30.183 21:27:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:30.183 21:27:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:30.183 21:27:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@105 -- # continue 2 00:26:30.183 21:27:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:30.183 21:27:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:30.183 21:27:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@105 -- # continue 2 00:26:30.183 21:27:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:30.183 21:27:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:30.183 21:27:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:30.183 21:27:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:30.183 21:27:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:30.183 21:27:24 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:30.183 192.168.100.9' 00:26:30.183 21:27:24 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:30.183 192.168.100.9' 00:26:30.183 21:27:24 -- nvmf/common.sh@446 -- # head -n 1 00:26:30.183 21:27:24 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:30.183 21:27:24 -- nvmf/common.sh@447 -- # tail -n +2 00:26:30.183 21:27:24 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:30.183 192.168.100.9' 00:26:30.183 21:27:24 -- nvmf/common.sh@447 -- # head -n 1 00:26:30.183 21:27:24 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:30.183 21:27:24 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:30.183 21:27:24 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:30.183 21:27:24 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:30.183 21:27:24 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:30.183 21:27:24 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:30.183 21:27:24 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:30.183 21:27:24 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:30.183 21:27:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:30.183 21:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:30.183 21:27:24 -- nvmf/common.sh@470 -- # nvmfpid=1466310 00:26:30.183 21:27:24 -- nvmf/common.sh@471 -- # waitforlisten 1466310 00:26:30.183 21:27:24 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:30.184 21:27:24 -- common/autotest_common.sh@817 -- # '[' -z 1466310 ']' 00:26:30.184 21:27:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:30.184 21:27:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:30.184 21:27:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:30.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:30.184 21:27:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:30.184 21:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:30.184 [2024-04-23 21:27:24.381371] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:30.184 [2024-04-23 21:27:24.381416] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:30.184 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.184 [2024-04-23 21:27:24.433583] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:30.443 [2024-04-23 21:27:24.501977] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:30.443 [2024-04-23 21:27:24.502018] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:30.443 [2024-04-23 21:27:24.502025] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:30.443 [2024-04-23 21:27:24.502030] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:30.443 [2024-04-23 21:27:24.502034] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:30.443 [2024-04-23 21:27:24.502154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:30.443 [2024-04-23 21:27:24.502166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:30.443 [2024-04-23 21:27:24.502303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:30.443 [2024-04-23 21:27:24.502304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:31.011 21:27:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:31.011 21:27:25 -- common/autotest_common.sh@850 -- # return 0 00:26:31.011 21:27:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:31.011 21:27:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:31.011 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.011 21:27:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:31.011 21:27:25 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:31.011 21:27:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:31.011 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.011 [2024-04-23 21:27:25.231254] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e859a0/0x1e89e90) succeed. 00:26:31.011 [2024-04-23 21:27:25.247826] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e86fe0/0x1ecb520) succeed. 00:26:31.271 21:27:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:31.271 21:27:25 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:31.271 21:27:25 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:31.271 21:27:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:31.271 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.271 21:27:25 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:31.271 21:27:25 -- target/shutdown.sh@28 -- # cat 00:26:31.271 21:27:25 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:31.271 21:27:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:31.271 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.271 Malloc1 00:26:31.271 [2024-04-23 21:27:25.462355] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:31.271 Malloc2 00:26:31.271 Malloc3 00:26:31.531 Malloc4 00:26:31.531 Malloc5 00:26:31.531 Malloc6 00:26:31.531 Malloc7 00:26:31.531 Malloc8 00:26:31.531 Malloc9 00:26:31.790 Malloc10 00:26:31.790 21:27:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:31.790 21:27:25 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:31.790 21:27:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:31.790 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.790 21:27:25 -- target/shutdown.sh@78 -- # perfpid=1466681 00:26:31.790 21:27:25 -- target/shutdown.sh@79 -- # waitforlisten 1466681 /var/tmp/bdevperf.sock 00:26:31.790 21:27:25 -- common/autotest_common.sh@817 -- # '[' -z 1466681 ']' 00:26:31.790 21:27:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:31.790 21:27:25 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:26:31.790 21:27:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:31.790 21:27:25 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:31.790 21:27:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:31.790 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:31.790 21:27:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:31.790 21:27:25 -- nvmf/common.sh@521 -- # config=() 00:26:31.790 21:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:31.790 21:27:25 -- nvmf/common.sh@521 -- # local subsystem config 00:26:31.790 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.790 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.790 { 00:26:31.790 "params": { 00:26:31.790 "name": "Nvme$subsystem", 00:26:31.790 "trtype": "$TEST_TRANSPORT", 00:26:31.790 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.790 "adrfam": "ipv4", 00:26:31.790 "trsvcid": "$NVMF_PORT", 00:26:31.790 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.790 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.790 "hdgst": ${hdgst:-false}, 00:26:31.790 "ddgst": ${ddgst:-false} 00:26:31.790 }, 00:26:31.790 "method": "bdev_nvme_attach_controller" 00:26:31.790 } 00:26:31.790 EOF 00:26:31.790 )") 00:26:31.790 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.790 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.790 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.790 { 00:26:31.790 "params": { 00:26:31.790 "name": "Nvme$subsystem", 00:26:31.790 "trtype": "$TEST_TRANSPORT", 00:26:31.790 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.790 "adrfam": "ipv4", 00:26:31.790 "trsvcid": "$NVMF_PORT", 00:26:31.790 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.790 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.790 "hdgst": ${hdgst:-false}, 00:26:31.790 "ddgst": ${ddgst:-false} 00:26:31.790 }, 00:26:31.790 "method": "bdev_nvme_attach_controller" 00:26:31.790 } 00:26:31.790 EOF 00:26:31.790 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 [2024-04-23 21:27:25.936694] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:31.791 [2024-04-23 21:27:25.936740] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:31.791 { 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme$subsystem", 00:26:31.791 "trtype": "$TEST_TRANSPORT", 00:26:31.791 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "$NVMF_PORT", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:31.791 "hdgst": ${hdgst:-false}, 00:26:31.791 "ddgst": ${ddgst:-false} 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 } 00:26:31.791 EOF 00:26:31.791 )") 00:26:31.791 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.791 21:27:25 -- nvmf/common.sh@543 -- # cat 00:26:31.791 21:27:25 -- nvmf/common.sh@545 -- # jq . 00:26:31.791 21:27:25 -- nvmf/common.sh@546 -- # IFS=, 00:26:31.791 21:27:25 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme1", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 },{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme2", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 },{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme3", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 },{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme4", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 },{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme5", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.791 "method": "bdev_nvme_attach_controller" 00:26:31.791 },{ 00:26:31.791 "params": { 00:26:31.791 "name": "Nvme6", 00:26:31.791 "trtype": "rdma", 00:26:31.791 "traddr": "192.168.100.8", 00:26:31.791 "adrfam": "ipv4", 00:26:31.791 "trsvcid": "4420", 00:26:31.791 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:31.791 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:31.791 "hdgst": false, 00:26:31.791 "ddgst": false 00:26:31.791 }, 00:26:31.792 "method": "bdev_nvme_attach_controller" 00:26:31.792 },{ 00:26:31.792 "params": { 00:26:31.792 "name": "Nvme7", 00:26:31.792 "trtype": "rdma", 00:26:31.792 "traddr": "192.168.100.8", 00:26:31.792 "adrfam": "ipv4", 00:26:31.792 "trsvcid": "4420", 00:26:31.792 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:31.792 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:31.792 "hdgst": false, 00:26:31.792 "ddgst": false 00:26:31.792 }, 00:26:31.792 "method": "bdev_nvme_attach_controller" 00:26:31.792 },{ 00:26:31.792 "params": { 00:26:31.792 "name": "Nvme8", 00:26:31.792 "trtype": "rdma", 00:26:31.792 "traddr": "192.168.100.8", 00:26:31.792 "adrfam": "ipv4", 00:26:31.792 "trsvcid": "4420", 00:26:31.792 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:31.792 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:31.792 "hdgst": false, 00:26:31.792 "ddgst": false 00:26:31.792 }, 00:26:31.792 "method": "bdev_nvme_attach_controller" 00:26:31.792 },{ 00:26:31.792 "params": { 00:26:31.792 "name": "Nvme9", 00:26:31.792 "trtype": "rdma", 00:26:31.792 "traddr": "192.168.100.8", 00:26:31.792 "adrfam": "ipv4", 00:26:31.792 "trsvcid": "4420", 00:26:31.792 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:31.792 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:31.792 "hdgst": false, 00:26:31.792 "ddgst": false 00:26:31.792 }, 00:26:31.792 "method": "bdev_nvme_attach_controller" 00:26:31.792 },{ 00:26:31.792 "params": { 00:26:31.792 "name": "Nvme10", 00:26:31.792 "trtype": "rdma", 00:26:31.792 "traddr": "192.168.100.8", 00:26:31.792 "adrfam": "ipv4", 00:26:31.792 "trsvcid": "4420", 00:26:31.792 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:31.792 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:31.792 "hdgst": false, 00:26:31.792 "ddgst": false 00:26:31.792 }, 00:26:31.792 "method": "bdev_nvme_attach_controller" 00:26:31.792 }' 00:26:31.792 [2024-04-23 21:27:25.989497] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.792 [2024-04-23 21:27:26.055687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:32.729 21:27:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:32.729 21:27:26 -- common/autotest_common.sh@850 -- # return 0 00:26:32.729 21:27:26 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:32.729 21:27:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:32.729 21:27:26 -- common/autotest_common.sh@10 -- # set +x 00:26:32.729 21:27:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:32.729 21:27:26 -- target/shutdown.sh@83 -- # kill -9 1466681 00:26:32.729 21:27:26 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:26:32.729 21:27:26 -- target/shutdown.sh@87 -- # sleep 1 00:26:33.666 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1466681 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:26:33.666 21:27:27 -- target/shutdown.sh@88 -- # kill -0 1466310 00:26:33.666 21:27:27 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:26:33.666 21:27:27 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:33.666 21:27:27 -- nvmf/common.sh@521 -- # config=() 00:26:33.666 21:27:27 -- nvmf/common.sh@521 -- # local subsystem config 00:26:33.666 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.666 { 00:26:33.666 "params": { 00:26:33.666 "name": "Nvme$subsystem", 00:26:33.666 "trtype": "$TEST_TRANSPORT", 00:26:33.666 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.666 "adrfam": "ipv4", 00:26:33.666 "trsvcid": "$NVMF_PORT", 00:26:33.666 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.666 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.666 "hdgst": ${hdgst:-false}, 00:26:33.666 "ddgst": ${ddgst:-false} 00:26:33.666 }, 00:26:33.666 "method": "bdev_nvme_attach_controller" 00:26:33.666 } 00:26:33.666 EOF 00:26:33.666 )") 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.666 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.666 { 00:26:33.666 "params": { 00:26:33.666 "name": "Nvme$subsystem", 00:26:33.666 "trtype": "$TEST_TRANSPORT", 00:26:33.666 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.666 "adrfam": "ipv4", 00:26:33.666 "trsvcid": "$NVMF_PORT", 00:26:33.666 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.666 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.666 "hdgst": ${hdgst:-false}, 00:26:33.666 "ddgst": ${ddgst:-false} 00:26:33.666 }, 00:26:33.666 "method": "bdev_nvme_attach_controller" 00:26:33.666 } 00:26:33.666 EOF 00:26:33.666 )") 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.666 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.666 { 00:26:33.666 "params": { 00:26:33.666 "name": "Nvme$subsystem", 00:26:33.666 "trtype": "$TEST_TRANSPORT", 00:26:33.666 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.666 "adrfam": "ipv4", 00:26:33.666 "trsvcid": "$NVMF_PORT", 00:26:33.666 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.666 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.666 "hdgst": ${hdgst:-false}, 00:26:33.666 "ddgst": ${ddgst:-false} 00:26:33.666 }, 00:26:33.666 "method": "bdev_nvme_attach_controller" 00:26:33.666 } 00:26:33.666 EOF 00:26:33.666 )") 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.666 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.666 { 00:26:33.666 "params": { 00:26:33.666 "name": "Nvme$subsystem", 00:26:33.666 "trtype": "$TEST_TRANSPORT", 00:26:33.666 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.666 "adrfam": "ipv4", 00:26:33.666 "trsvcid": "$NVMF_PORT", 00:26:33.666 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.666 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.666 "hdgst": ${hdgst:-false}, 00:26:33.666 "ddgst": ${ddgst:-false} 00:26:33.666 }, 00:26:33.666 "method": "bdev_nvme_attach_controller" 00:26:33.666 } 00:26:33.666 EOF 00:26:33.666 )") 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.666 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.666 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.666 { 00:26:33.666 "params": { 00:26:33.666 "name": "Nvme$subsystem", 00:26:33.666 "trtype": "$TEST_TRANSPORT", 00:26:33.666 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.666 "adrfam": "ipv4", 00:26:33.666 "trsvcid": "$NVMF_PORT", 00:26:33.666 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.666 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.666 "hdgst": ${hdgst:-false}, 00:26:33.666 "ddgst": ${ddgst:-false} 00:26:33.666 }, 00:26:33.666 "method": "bdev_nvme_attach_controller" 00:26:33.666 } 00:26:33.666 EOF 00:26:33.666 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.925 { 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme$subsystem", 00:26:33.925 "trtype": "$TEST_TRANSPORT", 00:26:33.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "$NVMF_PORT", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.925 "hdgst": ${hdgst:-false}, 00:26:33.925 "ddgst": ${ddgst:-false} 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 } 00:26:33.925 EOF 00:26:33.925 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 [2024-04-23 21:27:27.949392] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:33.925 [2024-04-23 21:27:27.949434] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467173 ] 00:26:33.925 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.925 { 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme$subsystem", 00:26:33.925 "trtype": "$TEST_TRANSPORT", 00:26:33.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "$NVMF_PORT", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.925 "hdgst": ${hdgst:-false}, 00:26:33.925 "ddgst": ${ddgst:-false} 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 } 00:26:33.925 EOF 00:26:33.925 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.925 { 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme$subsystem", 00:26:33.925 "trtype": "$TEST_TRANSPORT", 00:26:33.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "$NVMF_PORT", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.925 "hdgst": ${hdgst:-false}, 00:26:33.925 "ddgst": ${ddgst:-false} 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 } 00:26:33.925 EOF 00:26:33.925 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.925 { 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme$subsystem", 00:26:33.925 "trtype": "$TEST_TRANSPORT", 00:26:33.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "$NVMF_PORT", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.925 "hdgst": ${hdgst:-false}, 00:26:33.925 "ddgst": ${ddgst:-false} 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 } 00:26:33.925 EOF 00:26:33.925 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 21:27:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.925 { 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme$subsystem", 00:26:33.925 "trtype": "$TEST_TRANSPORT", 00:26:33.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "$NVMF_PORT", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.925 "hdgst": ${hdgst:-false}, 00:26:33.925 "ddgst": ${ddgst:-false} 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 } 00:26:33.925 EOF 00:26:33.925 )") 00:26:33.925 21:27:27 -- nvmf/common.sh@543 -- # cat 00:26:33.925 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.925 21:27:27 -- nvmf/common.sh@545 -- # jq . 00:26:33.925 21:27:27 -- nvmf/common.sh@546 -- # IFS=, 00:26:33.925 21:27:27 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme1", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme2", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme3", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme4", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme5", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme6", 00:26:33.925 "trtype": "rdma", 00:26:33.925 "traddr": "192.168.100.8", 00:26:33.925 "adrfam": "ipv4", 00:26:33.925 "trsvcid": "4420", 00:26:33.925 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:33.925 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:33.925 "hdgst": false, 00:26:33.925 "ddgst": false 00:26:33.925 }, 00:26:33.925 "method": "bdev_nvme_attach_controller" 00:26:33.925 },{ 00:26:33.925 "params": { 00:26:33.925 "name": "Nvme7", 00:26:33.926 "trtype": "rdma", 00:26:33.926 "traddr": "192.168.100.8", 00:26:33.926 "adrfam": "ipv4", 00:26:33.926 "trsvcid": "4420", 00:26:33.926 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:33.926 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:33.926 "hdgst": false, 00:26:33.926 "ddgst": false 00:26:33.926 }, 00:26:33.926 "method": "bdev_nvme_attach_controller" 00:26:33.926 },{ 00:26:33.926 "params": { 00:26:33.926 "name": "Nvme8", 00:26:33.926 "trtype": "rdma", 00:26:33.926 "traddr": "192.168.100.8", 00:26:33.926 "adrfam": "ipv4", 00:26:33.926 "trsvcid": "4420", 00:26:33.926 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:33.926 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:33.926 "hdgst": false, 00:26:33.926 "ddgst": false 00:26:33.926 }, 00:26:33.926 "method": "bdev_nvme_attach_controller" 00:26:33.926 },{ 00:26:33.926 "params": { 00:26:33.926 "name": "Nvme9", 00:26:33.926 "trtype": "rdma", 00:26:33.926 "traddr": "192.168.100.8", 00:26:33.926 "adrfam": "ipv4", 00:26:33.926 "trsvcid": "4420", 00:26:33.926 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:33.926 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:33.926 "hdgst": false, 00:26:33.926 "ddgst": false 00:26:33.926 }, 00:26:33.926 "method": "bdev_nvme_attach_controller" 00:26:33.926 },{ 00:26:33.926 "params": { 00:26:33.926 "name": "Nvme10", 00:26:33.926 "trtype": "rdma", 00:26:33.926 "traddr": "192.168.100.8", 00:26:33.926 "adrfam": "ipv4", 00:26:33.926 "trsvcid": "4420", 00:26:33.926 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:33.926 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:33.926 "hdgst": false, 00:26:33.926 "ddgst": false 00:26:33.926 }, 00:26:33.926 "method": "bdev_nvme_attach_controller" 00:26:33.926 }' 00:26:33.926 [2024-04-23 21:27:28.001894] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.926 [2024-04-23 21:27:28.068760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:34.859 Running I/O for 1 seconds... 00:26:36.236 00:26:36.236 Latency(us) 00:26:36.236 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:36.236 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme1n1 : 1.16 413.61 25.85 0.00 0.00 152776.60 6699.24 223696.21 00:26:36.236 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme2n1 : 1.16 413.22 25.83 0.00 0.00 150736.74 8252.68 152237.70 00:26:36.236 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme3n1 : 1.16 415.40 25.96 0.00 0.00 148107.47 3106.89 153791.15 00:26:36.236 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme4n1 : 1.16 416.74 26.05 0.00 0.00 145693.43 4466.16 146800.64 00:26:36.236 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme5n1 : 1.16 398.41 24.90 0.00 0.00 150125.57 8689.59 136703.24 00:26:36.236 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme6n1 : 1.17 411.77 25.74 0.00 0.00 143623.96 8835.22 129712.73 00:26:36.236 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme7n1 : 1.17 415.66 25.98 0.00 0.00 140485.01 9077.95 124275.67 00:26:36.236 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme8n1 : 1.17 402.49 25.16 0.00 0.00 142844.93 9175.04 115731.72 00:26:36.236 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme9n1 : 1.17 397.07 24.82 0.00 0.00 142720.33 9126.49 105634.32 00:26:36.236 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:36.236 Verification LBA range: start 0x0 length 0x400 00:26:36.236 Nvme10n1 : 1.17 382.23 23.89 0.00 0.00 146912.39 2706.39 166218.71 00:26:36.236 =================================================================================================================== 00:26:36.236 Total : 4066.60 254.16 0.00 0.00 146400.66 2706.39 223696.21 00:26:36.236 21:27:30 -- target/shutdown.sh@94 -- # stoptarget 00:26:36.236 21:27:30 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:36.236 21:27:30 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:36.236 21:27:30 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:36.236 21:27:30 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:36.236 21:27:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:36.236 21:27:30 -- nvmf/common.sh@117 -- # sync 00:26:36.236 21:27:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:36.236 21:27:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:36.236 21:27:30 -- nvmf/common.sh@120 -- # set +e 00:26:36.236 21:27:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:36.236 21:27:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:36.236 rmmod nvme_rdma 00:26:36.236 rmmod nvme_fabrics 00:26:36.236 21:27:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:36.236 21:27:30 -- nvmf/common.sh@124 -- # set -e 00:26:36.236 21:27:30 -- nvmf/common.sh@125 -- # return 0 00:26:36.236 21:27:30 -- nvmf/common.sh@478 -- # '[' -n 1466310 ']' 00:26:36.236 21:27:30 -- nvmf/common.sh@479 -- # killprocess 1466310 00:26:36.236 21:27:30 -- common/autotest_common.sh@936 -- # '[' -z 1466310 ']' 00:26:36.236 21:27:30 -- common/autotest_common.sh@940 -- # kill -0 1466310 00:26:36.236 21:27:30 -- common/autotest_common.sh@941 -- # uname 00:26:36.236 21:27:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.236 21:27:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466310 00:26:36.236 21:27:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:36.236 21:27:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:36.236 21:27:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466310' 00:26:36.236 killing process with pid 1466310 00:26:36.236 21:27:30 -- common/autotest_common.sh@955 -- # kill 1466310 00:26:36.236 21:27:30 -- common/autotest_common.sh@960 -- # wait 1466310 00:26:36.495 [2024-04-23 21:27:30.565142] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:36.755 21:27:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:36.755 21:27:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:36.755 00:26:36.755 real 0m12.005s 00:26:36.755 user 0m30.005s 00:26:36.755 sys 0m4.974s 00:26:36.755 21:27:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:36.755 21:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:36.755 ************************************ 00:26:36.755 END TEST nvmf_shutdown_tc1 00:26:36.755 ************************************ 00:26:36.755 21:27:30 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:26:36.755 21:27:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:36.755 21:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:36.755 21:27:30 -- common/autotest_common.sh@10 -- # set +x 00:26:37.015 ************************************ 00:26:37.015 START TEST nvmf_shutdown_tc2 00:26:37.015 ************************************ 00:26:37.015 21:27:31 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:26:37.015 21:27:31 -- target/shutdown.sh@99 -- # starttarget 00:26:37.015 21:27:31 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:37.015 21:27:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:37.015 21:27:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:37.015 21:27:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:37.015 21:27:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:37.015 21:27:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:37.015 21:27:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.015 21:27:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.015 21:27:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.015 21:27:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:37.015 21:27:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:37.015 21:27:31 -- common/autotest_common.sh@10 -- # set +x 00:26:37.015 21:27:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:37.015 21:27:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:37.015 21:27:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:37.015 21:27:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:37.015 21:27:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:37.015 21:27:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:37.015 21:27:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:37.015 21:27:31 -- nvmf/common.sh@295 -- # net_devs=() 00:26:37.015 21:27:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:37.015 21:27:31 -- nvmf/common.sh@296 -- # e810=() 00:26:37.015 21:27:31 -- nvmf/common.sh@296 -- # local -ga e810 00:26:37.015 21:27:31 -- nvmf/common.sh@297 -- # x722=() 00:26:37.015 21:27:31 -- nvmf/common.sh@297 -- # local -ga x722 00:26:37.015 21:27:31 -- nvmf/common.sh@298 -- # mlx=() 00:26:37.015 21:27:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:37.015 21:27:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:37.015 21:27:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:37.015 21:27:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:37.015 21:27:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:37.015 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:37.015 21:27:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:37.015 21:27:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:37.015 21:27:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:37.015 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:37.015 21:27:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:37.015 21:27:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:37.015 21:27:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:37.015 21:27:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:37.015 21:27:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:37.015 21:27:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:37.015 21:27:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:37.015 Found net devices under 0000:18:00.0: mlx_0_0 00:26:37.015 21:27:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:37.015 21:27:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:37.015 21:27:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:37.015 21:27:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:37.015 21:27:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:37.015 Found net devices under 0000:18:00.1: mlx_0_1 00:26:37.015 21:27:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:37.015 21:27:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:37.015 21:27:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:37.015 21:27:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:37.015 21:27:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:37.015 21:27:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:37.016 21:27:31 -- nvmf/common.sh@58 -- # uname 00:26:37.016 21:27:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:37.016 21:27:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:37.016 21:27:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:37.016 21:27:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:37.016 21:27:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:37.016 21:27:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:37.016 21:27:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:37.016 21:27:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:37.016 21:27:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:37.016 21:27:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:37.016 21:27:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:37.016 21:27:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:37.016 21:27:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:37.016 21:27:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:37.016 21:27:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:37.016 21:27:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:37.016 21:27:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@105 -- # continue 2 00:26:37.016 21:27:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@105 -- # continue 2 00:26:37.016 21:27:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:37.016 21:27:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:37.016 21:27:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:37.016 21:27:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:37.016 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:37.016 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:37.016 altname enp24s0f0np0 00:26:37.016 altname ens785f0np0 00:26:37.016 inet 192.168.100.8/24 scope global mlx_0_0 00:26:37.016 valid_lft forever preferred_lft forever 00:26:37.016 21:27:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:37.016 21:27:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:37.016 21:27:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:37.016 21:27:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:37.016 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:37.016 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:37.016 altname enp24s0f1np1 00:26:37.016 altname ens785f1np1 00:26:37.016 inet 192.168.100.9/24 scope global mlx_0_1 00:26:37.016 valid_lft forever preferred_lft forever 00:26:37.016 21:27:31 -- nvmf/common.sh@411 -- # return 0 00:26:37.016 21:27:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:37.016 21:27:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:37.016 21:27:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:37.016 21:27:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:37.016 21:27:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:37.016 21:27:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:37.016 21:27:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:37.016 21:27:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:37.016 21:27:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:37.016 21:27:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@105 -- # continue 2 00:26:37.016 21:27:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:37.016 21:27:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:37.016 21:27:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@105 -- # continue 2 00:26:37.016 21:27:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:37.016 21:27:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:37.016 21:27:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:37.016 21:27:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:37.016 21:27:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:37.016 21:27:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:37.275 21:27:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:37.275 21:27:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:37.275 21:27:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:37.275 21:27:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:37.275 192.168.100.9' 00:26:37.275 21:27:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:37.275 192.168.100.9' 00:26:37.275 21:27:31 -- nvmf/common.sh@446 -- # head -n 1 00:26:37.275 21:27:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:37.275 21:27:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:37.275 192.168.100.9' 00:26:37.275 21:27:31 -- nvmf/common.sh@447 -- # tail -n +2 00:26:37.275 21:27:31 -- nvmf/common.sh@447 -- # head -n 1 00:26:37.275 21:27:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:37.275 21:27:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:37.276 21:27:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:37.276 21:27:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:37.276 21:27:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:37.276 21:27:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:37.276 21:27:31 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:37.276 21:27:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:37.276 21:27:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:37.276 21:27:31 -- common/autotest_common.sh@10 -- # set +x 00:26:37.276 21:27:31 -- nvmf/common.sh@470 -- # nvmfpid=1467889 00:26:37.276 21:27:31 -- nvmf/common.sh@471 -- # waitforlisten 1467889 00:26:37.276 21:27:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:37.276 21:27:31 -- common/autotest_common.sh@817 -- # '[' -z 1467889 ']' 00:26:37.276 21:27:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:37.276 21:27:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:37.276 21:27:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:37.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:37.276 21:27:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:37.276 21:27:31 -- common/autotest_common.sh@10 -- # set +x 00:26:37.276 [2024-04-23 21:27:31.380845] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:37.276 [2024-04-23 21:27:31.380883] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:37.276 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.276 [2024-04-23 21:27:31.430709] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:37.276 [2024-04-23 21:27:31.501137] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:37.276 [2024-04-23 21:27:31.501172] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:37.276 [2024-04-23 21:27:31.501179] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:37.276 [2024-04-23 21:27:31.501184] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:37.276 [2024-04-23 21:27:31.501189] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:37.276 [2024-04-23 21:27:31.501289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:37.276 [2024-04-23 21:27:31.501369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:37.276 [2024-04-23 21:27:31.501476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:37.276 [2024-04-23 21:27:31.501478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:38.212 21:27:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:38.212 21:27:32 -- common/autotest_common.sh@850 -- # return 0 00:26:38.212 21:27:32 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:38.212 21:27:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:38.212 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.212 21:27:32 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:38.212 21:27:32 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:38.212 21:27:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:38.212 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.212 [2024-04-23 21:27:32.215155] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12719a0/0x1275e90) succeed. 00:26:38.212 [2024-04-23 21:27:32.224840] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1272fe0/0x12b7520) succeed. 00:26:38.212 21:27:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:38.212 21:27:32 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:38.212 21:27:32 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:38.212 21:27:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:38.212 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.212 21:27:32 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:38.212 21:27:32 -- target/shutdown.sh@28 -- # cat 00:26:38.212 21:27:32 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:38.212 21:27:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:38.212 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.212 Malloc1 00:26:38.212 [2024-04-23 21:27:32.420378] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:38.212 Malloc2 00:26:38.470 Malloc3 00:26:38.470 Malloc4 00:26:38.470 Malloc5 00:26:38.470 Malloc6 00:26:38.470 Malloc7 00:26:38.470 Malloc8 00:26:38.735 Malloc9 00:26:38.735 Malloc10 00:26:38.735 21:27:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:38.735 21:27:32 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:38.735 21:27:32 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:38.735 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.735 21:27:32 -- target/shutdown.sh@103 -- # perfpid=1468223 00:26:38.735 21:27:32 -- target/shutdown.sh@104 -- # waitforlisten 1468223 /var/tmp/bdevperf.sock 00:26:38.735 21:27:32 -- common/autotest_common.sh@817 -- # '[' -z 1468223 ']' 00:26:38.735 21:27:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:38.735 21:27:32 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:38.735 21:27:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:38.735 21:27:32 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:38.735 21:27:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:38.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:38.735 21:27:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:38.735 21:27:32 -- nvmf/common.sh@521 -- # config=() 00:26:38.735 21:27:32 -- common/autotest_common.sh@10 -- # set +x 00:26:38.735 21:27:32 -- nvmf/common.sh@521 -- # local subsystem config 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 [2024-04-23 21:27:32.887567] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:38.735 [2024-04-23 21:27:32.887604] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468223 ] 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.735 "trsvcid": "$NVMF_PORT", 00:26:38.735 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.735 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.735 "hdgst": ${hdgst:-false}, 00:26:38.735 "ddgst": ${ddgst:-false} 00:26:38.735 }, 00:26:38.735 "method": "bdev_nvme_attach_controller" 00:26:38.735 } 00:26:38.735 EOF 00:26:38.735 )") 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.735 21:27:32 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:38.735 21:27:32 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:38.735 { 00:26:38.735 "params": { 00:26:38.735 "name": "Nvme$subsystem", 00:26:38.735 "trtype": "$TEST_TRANSPORT", 00:26:38.735 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:38.735 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "$NVMF_PORT", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:38.736 "hdgst": ${hdgst:-false}, 00:26:38.736 "ddgst": ${ddgst:-false} 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 } 00:26:38.736 EOF 00:26:38.736 )") 00:26:38.736 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.736 21:27:32 -- nvmf/common.sh@543 -- # cat 00:26:38.736 21:27:32 -- nvmf/common.sh@545 -- # jq . 00:26:38.736 21:27:32 -- nvmf/common.sh@546 -- # IFS=, 00:26:38.736 21:27:32 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme1", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme2", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme3", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme4", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme5", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme6", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme7", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme8", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme9", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 },{ 00:26:38.736 "params": { 00:26:38.736 "name": "Nvme10", 00:26:38.736 "trtype": "rdma", 00:26:38.736 "traddr": "192.168.100.8", 00:26:38.736 "adrfam": "ipv4", 00:26:38.736 "trsvcid": "4420", 00:26:38.736 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:38.736 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:38.736 "hdgst": false, 00:26:38.736 "ddgst": false 00:26:38.736 }, 00:26:38.736 "method": "bdev_nvme_attach_controller" 00:26:38.736 }' 00:26:38.736 [2024-04-23 21:27:32.940260] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.997 [2024-04-23 21:27:33.005848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:39.979 Running I/O for 10 seconds... 00:26:39.979 21:27:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:39.979 21:27:33 -- common/autotest_common.sh@850 -- # return 0 00:26:39.979 21:27:33 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:39.979 21:27:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:39.979 21:27:33 -- common/autotest_common.sh@10 -- # set +x 00:26:39.980 21:27:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:39.980 21:27:34 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:39.980 21:27:34 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:39.980 21:27:34 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:39.980 21:27:34 -- target/shutdown.sh@57 -- # local ret=1 00:26:39.980 21:27:34 -- target/shutdown.sh@58 -- # local i 00:26:39.980 21:27:34 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:39.980 21:27:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:39.980 21:27:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:39.980 21:27:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:39.980 21:27:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:39.980 21:27:34 -- common/autotest_common.sh@10 -- # set +x 00:26:39.980 21:27:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:39.980 21:27:34 -- target/shutdown.sh@60 -- # read_io_count=19 00:26:39.980 21:27:34 -- target/shutdown.sh@63 -- # '[' 19 -ge 100 ']' 00:26:39.980 21:27:34 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:40.237 21:27:34 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:40.237 21:27:34 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:40.237 21:27:34 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:40.237 21:27:34 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:40.237 21:27:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:40.237 21:27:34 -- common/autotest_common.sh@10 -- # set +x 00:26:40.496 21:27:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:40.496 21:27:34 -- target/shutdown.sh@60 -- # read_io_count=171 00:26:40.496 21:27:34 -- target/shutdown.sh@63 -- # '[' 171 -ge 100 ']' 00:26:40.496 21:27:34 -- target/shutdown.sh@64 -- # ret=0 00:26:40.496 21:27:34 -- target/shutdown.sh@65 -- # break 00:26:40.496 21:27:34 -- target/shutdown.sh@69 -- # return 0 00:26:40.496 21:27:34 -- target/shutdown.sh@110 -- # killprocess 1468223 00:26:40.496 21:27:34 -- common/autotest_common.sh@936 -- # '[' -z 1468223 ']' 00:26:40.496 21:27:34 -- common/autotest_common.sh@940 -- # kill -0 1468223 00:26:40.496 21:27:34 -- common/autotest_common.sh@941 -- # uname 00:26:40.496 21:27:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.496 21:27:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1468223 00:26:40.496 21:27:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:40.496 21:27:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:40.496 21:27:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1468223' 00:26:40.496 killing process with pid 1468223 00:26:40.496 21:27:34 -- common/autotest_common.sh@955 -- # kill 1468223 00:26:40.496 21:27:34 -- common/autotest_common.sh@960 -- # wait 1468223 00:26:40.496 Received shutdown signal, test time was about 0.779992 seconds 00:26:40.496 00:26:40.496 Latency(us) 00:26:40.496 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:40.496 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme1n1 : 0.77 386.16 24.13 0.00 0.00 162489.80 5995.33 222142.77 00:26:40.496 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme2n1 : 0.77 416.83 26.05 0.00 0.00 147634.86 6262.33 155344.59 00:26:40.496 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme3n1 : 0.77 416.26 26.02 0.00 0.00 144962.29 7670.14 149130.81 00:26:40.496 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme4n1 : 0.77 415.67 25.98 0.00 0.00 142284.27 7912.87 142140.30 00:26:40.496 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme5n1 : 0.77 414.97 25.94 0.00 0.00 140026.01 8398.32 132042.90 00:26:40.496 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme6n1 : 0.77 414.39 25.90 0.00 0.00 136936.79 8738.13 125052.40 00:26:40.496 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme7n1 : 0.77 413.82 25.86 0.00 0.00 134238.06 8932.31 118838.61 00:26:40.496 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme8n1 : 0.77 413.24 25.83 0.00 0.00 131693.99 9223.59 111071.38 00:26:40.496 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme9n1 : 0.78 412.48 25.78 0.00 0.00 129927.17 9903.22 97478.73 00:26:40.496 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:40.496 Verification LBA range: start 0x0 length 0x400 00:26:40.496 Nvme10n1 : 0.78 328.46 20.53 0.00 0.00 159279.57 2694.26 223696.21 00:26:40.496 =================================================================================================================== 00:26:40.496 Total : 4032.27 252.02 0.00 0.00 142460.68 2694.26 223696.21 00:26:40.754 21:27:34 -- target/shutdown.sh@113 -- # sleep 1 00:26:41.688 21:27:35 -- target/shutdown.sh@114 -- # kill -0 1467889 00:26:41.688 21:27:35 -- target/shutdown.sh@116 -- # stoptarget 00:26:41.688 21:27:35 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:41.688 21:27:35 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:41.688 21:27:35 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:41.688 21:27:35 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:41.688 21:27:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:41.688 21:27:35 -- nvmf/common.sh@117 -- # sync 00:26:41.688 21:27:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:41.688 21:27:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:41.688 21:27:35 -- nvmf/common.sh@120 -- # set +e 00:26:41.688 21:27:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:41.688 21:27:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:41.688 rmmod nvme_rdma 00:26:41.946 rmmod nvme_fabrics 00:26:41.946 21:27:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:41.946 21:27:35 -- nvmf/common.sh@124 -- # set -e 00:26:41.946 21:27:35 -- nvmf/common.sh@125 -- # return 0 00:26:41.946 21:27:35 -- nvmf/common.sh@478 -- # '[' -n 1467889 ']' 00:26:41.946 21:27:35 -- nvmf/common.sh@479 -- # killprocess 1467889 00:26:41.946 21:27:35 -- common/autotest_common.sh@936 -- # '[' -z 1467889 ']' 00:26:41.946 21:27:35 -- common/autotest_common.sh@940 -- # kill -0 1467889 00:26:41.946 21:27:35 -- common/autotest_common.sh@941 -- # uname 00:26:41.946 21:27:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:41.946 21:27:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467889 00:26:41.946 21:27:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:41.946 21:27:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:41.946 21:27:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467889' 00:26:41.946 killing process with pid 1467889 00:26:41.946 21:27:36 -- common/autotest_common.sh@955 -- # kill 1467889 00:26:41.946 21:27:36 -- common/autotest_common.sh@960 -- # wait 1467889 00:26:41.946 [2024-04-23 21:27:36.102831] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:42.514 21:27:36 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:42.514 21:27:36 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:42.514 00:26:42.514 real 0m5.371s 00:26:42.514 user 0m21.746s 00:26:42.514 sys 0m0.972s 00:26:42.514 21:27:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:42.515 21:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.515 ************************************ 00:26:42.515 END TEST nvmf_shutdown_tc2 00:26:42.515 ************************************ 00:26:42.515 21:27:36 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:26:42.515 21:27:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:42.515 21:27:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:42.515 21:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.515 ************************************ 00:26:42.515 START TEST nvmf_shutdown_tc3 00:26:42.515 ************************************ 00:26:42.515 21:27:36 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:26:42.515 21:27:36 -- target/shutdown.sh@121 -- # starttarget 00:26:42.515 21:27:36 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:42.515 21:27:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:42.515 21:27:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:42.515 21:27:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:42.515 21:27:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:42.515 21:27:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:42.515 21:27:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:42.515 21:27:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:42.515 21:27:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:42.515 21:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.515 21:27:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:42.515 21:27:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:42.515 21:27:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:42.515 21:27:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:42.515 21:27:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:42.515 21:27:36 -- nvmf/common.sh@295 -- # net_devs=() 00:26:42.515 21:27:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@296 -- # e810=() 00:26:42.515 21:27:36 -- nvmf/common.sh@296 -- # local -ga e810 00:26:42.515 21:27:36 -- nvmf/common.sh@297 -- # x722=() 00:26:42.515 21:27:36 -- nvmf/common.sh@297 -- # local -ga x722 00:26:42.515 21:27:36 -- nvmf/common.sh@298 -- # mlx=() 00:26:42.515 21:27:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:42.515 21:27:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:42.515 21:27:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:42.515 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:42.515 21:27:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:42.515 21:27:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:42.515 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:42.515 21:27:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:42.515 21:27:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:42.515 21:27:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:42.515 21:27:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:42.515 Found net devices under 0000:18:00.0: mlx_0_0 00:26:42.515 21:27:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:42.515 21:27:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:42.515 21:27:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:42.515 Found net devices under 0000:18:00.1: mlx_0_1 00:26:42.515 21:27:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:42.515 21:27:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:42.515 21:27:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:42.515 21:27:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:42.515 21:27:36 -- nvmf/common.sh@58 -- # uname 00:26:42.515 21:27:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:42.515 21:27:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:42.515 21:27:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:42.515 21:27:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:42.515 21:27:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:42.515 21:27:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:42.515 21:27:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:42.515 21:27:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:42.515 21:27:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:42.515 21:27:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:42.515 21:27:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:42.515 21:27:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:42.515 21:27:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:42.515 21:27:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:42.515 21:27:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:42.515 21:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:42.515 21:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:42.515 21:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.515 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:42.515 21:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:42.515 21:27:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:42.515 21:27:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:42.515 21:27:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:42.515 21:27:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:42.515 21:27:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:42.515 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:42.515 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:42.515 altname enp24s0f0np0 00:26:42.515 altname ens785f0np0 00:26:42.515 inet 192.168.100.8/24 scope global mlx_0_0 00:26:42.515 valid_lft forever preferred_lft forever 00:26:42.515 21:27:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:42.515 21:27:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:42.515 21:27:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:42.515 21:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:42.515 21:27:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:42.515 21:27:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:42.515 21:27:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:42.515 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:42.515 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:42.515 altname enp24s0f1np1 00:26:42.515 altname ens785f1np1 00:26:42.515 inet 192.168.100.9/24 scope global mlx_0_1 00:26:42.515 valid_lft forever preferred_lft forever 00:26:42.515 21:27:36 -- nvmf/common.sh@411 -- # return 0 00:26:42.515 21:27:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:42.515 21:27:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:42.515 21:27:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:42.516 21:27:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:42.516 21:27:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:42.516 21:27:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:42.516 21:27:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:42.516 21:27:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:42.516 21:27:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:42.775 21:27:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:42.776 21:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:42.776 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.776 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:42.776 21:27:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:42.776 21:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:42.776 21:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:42.776 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.776 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:42.776 21:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:42.776 21:27:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:42.776 21:27:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:42.776 21:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:42.776 21:27:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:42.776 21:27:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:42.776 21:27:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:42.776 21:27:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:42.776 21:27:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:42.776 21:27:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:42.776 21:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:42.776 21:27:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:42.776 192.168.100.9' 00:26:42.776 21:27:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:42.776 192.168.100.9' 00:26:42.776 21:27:36 -- nvmf/common.sh@446 -- # head -n 1 00:26:42.776 21:27:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:42.776 21:27:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:42.776 192.168.100.9' 00:26:42.776 21:27:36 -- nvmf/common.sh@447 -- # tail -n +2 00:26:42.776 21:27:36 -- nvmf/common.sh@447 -- # head -n 1 00:26:42.776 21:27:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:42.776 21:27:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:42.776 21:27:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:42.776 21:27:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:42.776 21:27:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:42.776 21:27:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:42.776 21:27:36 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:42.776 21:27:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:42.776 21:27:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:42.776 21:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.776 21:27:36 -- nvmf/common.sh@470 -- # nvmfpid=1469186 00:26:42.776 21:27:36 -- nvmf/common.sh@471 -- # waitforlisten 1469186 00:26:42.776 21:27:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:42.776 21:27:36 -- common/autotest_common.sh@817 -- # '[' -z 1469186 ']' 00:26:42.776 21:27:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:42.776 21:27:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:42.776 21:27:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:42.776 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:42.776 21:27:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:42.776 21:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.776 [2024-04-23 21:27:36.905084] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:42.776 [2024-04-23 21:27:36.905127] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:42.776 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.776 [2024-04-23 21:27:36.958116] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:42.776 [2024-04-23 21:27:37.025828] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:42.776 [2024-04-23 21:27:37.025866] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:42.776 [2024-04-23 21:27:37.025872] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:42.776 [2024-04-23 21:27:37.025877] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:42.776 [2024-04-23 21:27:37.025882] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:42.776 [2024-04-23 21:27:37.025978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:42.776 [2024-04-23 21:27:37.026062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:42.776 [2024-04-23 21:27:37.026146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:42.776 [2024-04-23 21:27:37.026148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:43.713 21:27:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:43.713 21:27:37 -- common/autotest_common.sh@850 -- # return 0 00:26:43.713 21:27:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:43.713 21:27:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:43.713 21:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:43.713 21:27:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:43.713 21:27:37 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:43.713 21:27:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:43.713 21:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:43.713 [2024-04-23 21:27:37.745558] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x9829a0/0x986e90) succeed. 00:26:43.713 [2024-04-23 21:27:37.754906] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x983fe0/0x9c8520) succeed. 00:26:43.713 21:27:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:43.713 21:27:37 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:43.713 21:27:37 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:43.713 21:27:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:43.713 21:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:43.713 21:27:37 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:43.713 21:27:37 -- target/shutdown.sh@28 -- # cat 00:26:43.713 21:27:37 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:43.713 21:27:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:43.713 21:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:43.713 Malloc1 00:26:43.713 [2024-04-23 21:27:37.952865] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:43.713 Malloc2 00:26:43.972 Malloc3 00:26:43.972 Malloc4 00:26:43.972 Malloc5 00:26:43.972 Malloc6 00:26:43.972 Malloc7 00:26:43.972 Malloc8 00:26:44.231 Malloc9 00:26:44.231 Malloc10 00:26:44.231 21:27:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:44.231 21:27:38 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:44.231 21:27:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:44.231 21:27:38 -- common/autotest_common.sh@10 -- # set +x 00:26:44.231 21:27:38 -- target/shutdown.sh@125 -- # perfpid=1469513 00:26:44.231 21:27:38 -- target/shutdown.sh@126 -- # waitforlisten 1469513 /var/tmp/bdevperf.sock 00:26:44.231 21:27:38 -- common/autotest_common.sh@817 -- # '[' -z 1469513 ']' 00:26:44.231 21:27:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:44.231 21:27:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:44.231 21:27:38 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:44.231 21:27:38 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:44.231 21:27:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:44.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:44.231 21:27:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:44.231 21:27:38 -- nvmf/common.sh@521 -- # config=() 00:26:44.231 21:27:38 -- common/autotest_common.sh@10 -- # set +x 00:26:44.231 21:27:38 -- nvmf/common.sh@521 -- # local subsystem config 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 [2024-04-23 21:27:38.419919] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:44.232 [2024-04-23 21:27:38.419960] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469513 ] 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.232 21:27:38 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:44.232 { 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme$subsystem", 00:26:44.232 "trtype": "$TEST_TRANSPORT", 00:26:44.232 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "$NVMF_PORT", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:44.232 "hdgst": ${hdgst:-false}, 00:26:44.232 "ddgst": ${ddgst:-false} 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 } 00:26:44.232 EOF 00:26:44.232 )") 00:26:44.232 21:27:38 -- nvmf/common.sh@543 -- # cat 00:26:44.232 21:27:38 -- nvmf/common.sh@545 -- # jq . 00:26:44.232 21:27:38 -- nvmf/common.sh@546 -- # IFS=, 00:26:44.232 21:27:38 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme1", 00:26:44.232 "trtype": "rdma", 00:26:44.232 "traddr": "192.168.100.8", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "4420", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:44.232 "hdgst": false, 00:26:44.232 "ddgst": false 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 },{ 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme2", 00:26:44.232 "trtype": "rdma", 00:26:44.232 "traddr": "192.168.100.8", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "4420", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:44.232 "hdgst": false, 00:26:44.232 "ddgst": false 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.232 },{ 00:26:44.232 "params": { 00:26:44.232 "name": "Nvme3", 00:26:44.232 "trtype": "rdma", 00:26:44.232 "traddr": "192.168.100.8", 00:26:44.232 "adrfam": "ipv4", 00:26:44.232 "trsvcid": "4420", 00:26:44.232 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:44.232 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:44.232 "hdgst": false, 00:26:44.232 "ddgst": false 00:26:44.232 }, 00:26:44.232 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme4", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme5", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme6", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme7", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme8", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme9", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 },{ 00:26:44.233 "params": { 00:26:44.233 "name": "Nvme10", 00:26:44.233 "trtype": "rdma", 00:26:44.233 "traddr": "192.168.100.8", 00:26:44.233 "adrfam": "ipv4", 00:26:44.233 "trsvcid": "4420", 00:26:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:44.233 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:44.233 "hdgst": false, 00:26:44.233 "ddgst": false 00:26:44.233 }, 00:26:44.233 "method": "bdev_nvme_attach_controller" 00:26:44.233 }' 00:26:44.233 [2024-04-23 21:27:38.471008] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.492 [2024-04-23 21:27:38.537563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:45.428 Running I/O for 10 seconds... 00:26:45.428 21:27:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:45.428 21:27:39 -- common/autotest_common.sh@850 -- # return 0 00:26:45.428 21:27:39 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:45.428 21:27:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.428 21:27:39 -- common/autotest_common.sh@10 -- # set +x 00:26:45.428 21:27:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.428 21:27:39 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:45.428 21:27:39 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:45.428 21:27:39 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:45.428 21:27:39 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:45.428 21:27:39 -- target/shutdown.sh@57 -- # local ret=1 00:26:45.429 21:27:39 -- target/shutdown.sh@58 -- # local i 00:26:45.429 21:27:39 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:45.429 21:27:39 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:45.429 21:27:39 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:45.429 21:27:39 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:45.429 21:27:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.429 21:27:39 -- common/autotest_common.sh@10 -- # set +x 00:26:45.429 21:27:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.429 21:27:39 -- target/shutdown.sh@60 -- # read_io_count=3 00:26:45.429 21:27:39 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:26:45.429 21:27:39 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:45.687 21:27:39 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:45.687 21:27:39 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:45.687 21:27:39 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:45.687 21:27:39 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:45.687 21:27:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:45.687 21:27:39 -- common/autotest_common.sh@10 -- # set +x 00:26:45.946 21:27:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:45.946 21:27:40 -- target/shutdown.sh@60 -- # read_io_count=146 00:26:45.946 21:27:40 -- target/shutdown.sh@63 -- # '[' 146 -ge 100 ']' 00:26:45.946 21:27:40 -- target/shutdown.sh@64 -- # ret=0 00:26:45.946 21:27:40 -- target/shutdown.sh@65 -- # break 00:26:45.946 21:27:40 -- target/shutdown.sh@69 -- # return 0 00:26:45.946 21:27:40 -- target/shutdown.sh@135 -- # killprocess 1469186 00:26:45.946 21:27:40 -- common/autotest_common.sh@936 -- # '[' -z 1469186 ']' 00:26:45.946 21:27:40 -- common/autotest_common.sh@940 -- # kill -0 1469186 00:26:45.946 21:27:40 -- common/autotest_common.sh@941 -- # uname 00:26:45.946 21:27:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:45.946 21:27:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1469186 00:26:45.946 21:27:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:45.946 21:27:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:45.946 21:27:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1469186' 00:26:45.946 killing process with pid 1469186 00:26:45.946 21:27:40 -- common/autotest_common.sh@955 -- # kill 1469186 00:26:45.946 21:27:40 -- common/autotest_common.sh@960 -- # wait 1469186 00:26:45.946 [2024-04-23 21:27:40.176811] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:46.514 21:27:40 -- target/shutdown.sh@136 -- # nvmfpid= 00:26:46.514 21:27:40 -- target/shutdown.sh@139 -- # sleep 1 00:26:47.086 [2024-04-23 21:27:41.129868] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.132602] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.134642] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.137218] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.139748] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.142345] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.144432] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:26:47.086 [2024-04-23 21:27:41.144526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afcff00 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.086 [2024-04-23 21:27:41.144602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afbfe80 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.086 [2024-04-23 21:27:41.144660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afafe00 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.086 [2024-04-23 21:27:41.144718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af9fd80 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.086 [2024-04-23 21:27:41.144775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af8fd00 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.086 [2024-04-23 21:27:41.144832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af7fc80 len:0x10000 key:0x183500 00:26:47.086 [2024-04-23 21:27:41.144854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.144889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af6fc00 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.144919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.144933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af5fb80 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.144941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.144959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af4fb00 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.144967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.144981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af3fa80 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.144989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.145003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af2fa00 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.145012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.145025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af1f980 len:0x10000 key:0x183500 00:26:47.087 [2024-04-23 21:27:41.145033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.145046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaefe00 len:0x10000 key:0x184000 00:26:47.087 [2024-04-23 21:27:41.145055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147535] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:26:47.087 [2024-04-23 21:27:41.147684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1f0000 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1dff80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1cff00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1bfe80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1afe00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b19fd80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b18fd00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b17fc80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b16fc00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b15fb80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b14fb00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b13fa80 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b12fa00 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b11f980 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b10f900 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ff880 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.147984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.147994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.087 [2024-04-23 21:27:41.148200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0x183c00 00:26:47.087 [2024-04-23 21:27:41.148210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0x183c00 00:26:47.088 [2024-04-23 21:27:41.148229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0x183c00 00:26:47.088 [2024-04-23 21:27:41.148247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0x183c00 00:26:47.088 [2024-04-23 21:27:41.148266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x183400 00:26:47.088 [2024-04-23 21:27:41.148852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x183d00 00:26:47.088 [2024-04-23 21:27:41.148870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.088 [2024-04-23 21:27:41.148880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0x183500 00:26:47.088 [2024-04-23 21:27:41.148888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:f76a1950 sqhd:e08c p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151207] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:26:47.089 [2024-04-23 21:27:41.151227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x183d00 00:26:47.089 [2024-04-23 21:27:41.151470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x184300 00:26:47.089 [2024-04-23 21:27:41.151868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.089 [2024-04-23 21:27:41.151877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.151986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.151995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.152013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x184300 00:26:47.090 [2024-04-23 21:27:41.152032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x183e00 00:26:47.090 [2024-04-23 21:27:41.152378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.152388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x183d00 00:26:47.090 [2024-04-23 21:27:41.152396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:414f440 sqhd:a260 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.155239] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:26:47.090 [2024-04-23 21:27:41.155325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.155338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.155348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.155355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.155364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.155372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.155382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.155389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:47.090 [2024-04-23 21:27:41.157852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.090 [2024-04-23 21:27:41.157882] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:26:47.090 [2024-04-23 21:27:41.157902] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.090 [2024-04-23 21:27:41.157937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.157960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.090 [2024-04-23 21:27:41.157983] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.090 [2024-04-23 21:27:41.158004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.090 [2024-04-23 21:27:41.158037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.158047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.158055] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.158063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.160365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.160396] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:26:47.091 [2024-04-23 21:27:41.160417] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.091 [2024-04-23 21:27:41.160451] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.160475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.160499] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.160528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.160554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.160575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.160598] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.160620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.162947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.162978] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:26:47.091 [2024-04-23 21:27:41.162996] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.091 [2024-04-23 21:27:41.163031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.163055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.163077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.163098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.163122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.163142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.163174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.163183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.165200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.165230] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:26:47.091 [2024-04-23 21:27:41.165248] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.091 [2024-04-23 21:27:41.165287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.165297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.165306] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.165315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.165324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.165331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.165340] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.165351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.167378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.167410] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:47.091 [2024-04-23 21:27:41.167429] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.091 [2024-04-23 21:27:41.167462] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.167485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.167508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.167529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.167551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.167573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.167595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.167617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.169846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.169876] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:47.091 [2024-04-23 21:27:41.169894] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.091 [2024-04-23 21:27:41.169927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.169949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.169972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.169993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.170015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.170035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.170057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.091 [2024-04-23 21:27:41.170078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.091 [2024-04-23 21:27:41.172122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.091 [2024-04-23 21:27:41.172152] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:26:47.091 [2024-04-23 21:27:41.172171] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.172203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.172232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.172255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.172285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.172309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.172329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.172353] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.172374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.174350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.092 [2024-04-23 21:27:41.174381] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:26:47.092 [2024-04-23 21:27:41.174399] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.174434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.174457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.174479] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.174500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.174523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.174544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.174567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.174588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.176603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.092 [2024-04-23 21:27:41.176633] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:26:47.092 [2024-04-23 21:27:41.176651] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.176684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.176707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.176730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.176751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.176773] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.176800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.176823] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:47.092 [2024-04-23 21:27:41.176843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:33524 cdw0:0 sqhd:2900 p:1 m:1 dnr:0 00:26:47.092 [2024-04-23 21:27:41.193316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:47.092 [2024-04-23 21:27:41.193333] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:26:47.092 [2024-04-23 21:27:41.193340] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200861] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:47.092 [2024-04-23 21:27:41.200889] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:47.092 [2024-04-23 21:27:41.200897] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:26:47.092 [2024-04-23 21:27:41.200934] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200945] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200953] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200970] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200980] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200989] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.200998] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:47.092 [2024-04-23 21:27:41.201069] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:26:47.092 [2024-04-23 21:27:41.201079] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:26:47.092 [2024-04-23 21:27:41.201086] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:26:47.092 [2024-04-23 21:27:41.201097] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:26:47.092 [2024-04-23 21:27:41.203131] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:26:47.092 task offset: 40960 on job bdev=Nvme6n1 fails 00:26:47.092 00:26:47.092 Latency(us) 00:26:47.092 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.092 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme1n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme1n1 : 1.81 141.82 8.86 35.45 0.00 359189.92 24563.86 1062557.01 00:26:47.092 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme2n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme2n1 : 1.81 141.75 8.86 35.44 0.00 356165.71 29321.29 1062557.01 00:26:47.092 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme3n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme3n1 : 1.81 141.69 8.86 35.42 0.00 353408.64 38059.43 1062557.01 00:26:47.092 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme4n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme4n1 : 1.81 158.23 9.89 35.41 0.00 320619.83 5024.43 1062557.01 00:26:47.092 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme5n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme5n1 : 1.81 141.58 8.85 35.39 0.00 347946.10 41360.50 1062557.01 00:26:47.092 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme6n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme6n1 : 1.81 148.71 9.29 35.38 0.00 331396.04 9660.49 1056343.23 00:26:47.092 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme7n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme7n1 : 1.81 150.31 9.39 35.37 0.00 325653.53 14272.28 1056343.23 00:26:47.092 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme8n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme8n1 : 1.81 151.35 9.46 35.35 0.00 319213.03 16311.18 1062557.01 00:26:47.092 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme9n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme9n1 : 1.81 141.35 8.83 35.34 0.00 337170.89 48933.55 1112267.28 00:26:47.092 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:47.092 Job: Nvme10n1 ended in about 1.81 seconds with error 00:26:47.092 Verification LBA range: start 0x0 length 0x400 00:26:47.092 Nvme10n1 : 1.81 105.97 6.62 35.32 0.00 417853.44 53593.88 1099839.72 00:26:47.092 =================================================================================================================== 00:26:47.092 Total : 1422.76 88.92 353.88 0.00 344879.52 5024.43 1112267.28 00:26:47.092 [2024-04-23 21:27:41.222617] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:26:47.092 [2024-04-23 21:27:41.222638] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:26:47.092 [2024-04-23 21:27:41.222649] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:26:47.092 [2024-04-23 21:27:41.231485] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.092 [2024-04-23 21:27:41.231536] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.092 [2024-04-23 21:27:41.231556] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:47.092 [2024-04-23 21:27:41.231690] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.092 [2024-04-23 21:27:41.231716] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.092 [2024-04-23 21:27:41.231733] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:26:47.092 [2024-04-23 21:27:41.231855] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.231879] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.231895] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:26:47.093 [2024-04-23 21:27:41.235552] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.235601] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.235639] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:26:47.093 [2024-04-23 21:27:41.235745] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.235770] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.235786] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:26:47.093 [2024-04-23 21:27:41.235877] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.235902] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.235920] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:26:47.093 [2024-04-23 21:27:41.236020] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.236044] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.236060] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:26:47.093 [2024-04-23 21:27:41.236766] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.236779] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.236786] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:26:47.093 [2024-04-23 21:27:41.236869] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.236880] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.236886] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:26:47.093 [2024-04-23 21:27:41.236957] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:47.093 [2024-04-23 21:27:41.236967] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:47.093 [2024-04-23 21:27:41.236974] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:26:47.352 21:27:41 -- target/shutdown.sh@142 -- # kill -9 1469513 00:26:47.352 21:27:41 -- target/shutdown.sh@144 -- # stoptarget 00:26:47.352 21:27:41 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:47.352 21:27:41 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:47.352 21:27:41 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:47.352 21:27:41 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:47.352 21:27:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:47.352 21:27:41 -- nvmf/common.sh@117 -- # sync 00:26:47.352 21:27:41 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:47.352 21:27:41 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:47.352 21:27:41 -- nvmf/common.sh@120 -- # set +e 00:26:47.352 21:27:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:47.352 21:27:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:47.352 rmmod nvme_rdma 00:26:47.352 rmmod nvme_fabrics 00:26:47.352 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 1469513 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:26:47.352 21:27:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:47.352 21:27:41 -- nvmf/common.sh@124 -- # set -e 00:26:47.352 21:27:41 -- nvmf/common.sh@125 -- # return 0 00:26:47.610 21:27:41 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:26:47.610 21:27:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:47.610 21:27:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:47.610 00:26:47.610 real 0m4.971s 00:26:47.610 user 0m16.901s 00:26:47.610 sys 0m1.047s 00:26:47.610 21:27:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:47.610 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.610 ************************************ 00:26:47.610 END TEST nvmf_shutdown_tc3 00:26:47.610 ************************************ 00:26:47.610 21:27:41 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:26:47.610 00:26:47.610 real 0m22.964s 00:26:47.610 user 1m8.893s 00:26:47.610 sys 0m7.340s 00:26:47.610 21:27:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:47.610 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.610 ************************************ 00:26:47.610 END TEST nvmf_shutdown 00:26:47.610 ************************************ 00:26:47.610 21:27:41 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:26:47.610 21:27:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:47.610 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.610 21:27:41 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:26:47.610 21:27:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:47.611 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.611 21:27:41 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:26:47.611 21:27:41 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:26:47.611 21:27:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:47.611 21:27:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:47.611 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.611 ************************************ 00:26:47.611 START TEST nvmf_multicontroller 00:26:47.611 ************************************ 00:26:47.611 21:27:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:26:47.870 * Looking for test storage... 00:26:47.870 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:26:47.870 21:27:41 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:47.870 21:27:41 -- nvmf/common.sh@7 -- # uname -s 00:26:47.870 21:27:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:47.870 21:27:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:47.870 21:27:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:47.870 21:27:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:47.870 21:27:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:47.870 21:27:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:47.870 21:27:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:47.870 21:27:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:47.870 21:27:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:47.870 21:27:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:47.870 21:27:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:47.870 21:27:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:47.870 21:27:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:47.870 21:27:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:47.870 21:27:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:47.870 21:27:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:47.870 21:27:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:47.870 21:27:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:47.870 21:27:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:47.870 21:27:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:47.870 21:27:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:47.870 21:27:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:47.870 21:27:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:47.870 21:27:41 -- paths/export.sh@5 -- # export PATH 00:26:47.870 21:27:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:47.870 21:27:41 -- nvmf/common.sh@47 -- # : 0 00:26:47.870 21:27:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:47.870 21:27:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:47.870 21:27:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:47.870 21:27:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:47.870 21:27:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:47.870 21:27:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:47.870 21:27:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:47.870 21:27:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:47.870 21:27:41 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:47.870 21:27:41 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:47.870 21:27:41 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:26:47.870 21:27:41 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:26:47.870 21:27:41 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:47.870 21:27:41 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:26:47.871 21:27:41 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:26:47.871 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:26:47.871 21:27:41 -- host/multicontroller.sh@20 -- # exit 0 00:26:47.871 00:26:47.871 real 0m0.122s 00:26:47.871 user 0m0.060s 00:26:47.871 sys 0m0.070s 00:26:47.871 21:27:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:47.871 21:27:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.871 ************************************ 00:26:47.871 END TEST nvmf_multicontroller 00:26:47.871 ************************************ 00:26:47.871 21:27:42 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:26:47.871 21:27:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:47.871 21:27:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:47.871 21:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:48.130 ************************************ 00:26:48.130 START TEST nvmf_aer 00:26:48.130 ************************************ 00:26:48.130 21:27:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:26:48.130 * Looking for test storage... 00:26:48.130 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:26:48.130 21:27:42 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:48.130 21:27:42 -- nvmf/common.sh@7 -- # uname -s 00:26:48.130 21:27:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:48.130 21:27:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:48.130 21:27:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:48.130 21:27:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:48.130 21:27:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:48.130 21:27:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:48.130 21:27:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:48.130 21:27:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:48.130 21:27:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:48.130 21:27:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:48.130 21:27:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:48.130 21:27:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:48.130 21:27:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:48.130 21:27:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:48.130 21:27:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:48.130 21:27:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:48.130 21:27:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:48.130 21:27:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:48.130 21:27:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:48.130 21:27:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:48.131 21:27:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.131 21:27:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.131 21:27:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.131 21:27:42 -- paths/export.sh@5 -- # export PATH 00:26:48.131 21:27:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:48.131 21:27:42 -- nvmf/common.sh@47 -- # : 0 00:26:48.131 21:27:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:48.131 21:27:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:48.131 21:27:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:48.131 21:27:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:48.131 21:27:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:48.131 21:27:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:48.131 21:27:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:48.131 21:27:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:48.131 21:27:42 -- host/aer.sh@11 -- # nvmftestinit 00:26:48.131 21:27:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:48.131 21:27:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:48.131 21:27:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:48.131 21:27:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:48.131 21:27:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:48.131 21:27:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:48.131 21:27:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:48.131 21:27:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:48.131 21:27:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:48.131 21:27:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:48.131 21:27:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:48.131 21:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:53.407 21:27:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:53.407 21:27:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:53.407 21:27:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:53.407 21:27:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:53.407 21:27:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:53.407 21:27:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:53.407 21:27:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:53.407 21:27:47 -- nvmf/common.sh@295 -- # net_devs=() 00:26:53.407 21:27:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:53.407 21:27:47 -- nvmf/common.sh@296 -- # e810=() 00:26:53.407 21:27:47 -- nvmf/common.sh@296 -- # local -ga e810 00:26:53.407 21:27:47 -- nvmf/common.sh@297 -- # x722=() 00:26:53.407 21:27:47 -- nvmf/common.sh@297 -- # local -ga x722 00:26:53.407 21:27:47 -- nvmf/common.sh@298 -- # mlx=() 00:26:53.407 21:27:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:53.407 21:27:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:53.407 21:27:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:53.407 21:27:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:53.407 21:27:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:53.407 21:27:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:53.407 21:27:47 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:53.407 21:27:47 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:53.407 21:27:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:53.407 21:27:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:53.407 21:27:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:53.407 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:53.407 21:27:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:53.407 21:27:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:53.408 21:27:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:53.408 21:27:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:53.408 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:53.408 21:27:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:53.408 21:27:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:53.408 21:27:47 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:53.408 21:27:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.408 21:27:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:53.408 21:27:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.408 21:27:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:53.408 Found net devices under 0000:18:00.0: mlx_0_0 00:26:53.408 21:27:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.408 21:27:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:53.408 21:27:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:53.408 21:27:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:53.408 21:27:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:53.408 21:27:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:53.408 Found net devices under 0000:18:00.1: mlx_0_1 00:26:53.408 21:27:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:53.408 21:27:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:53.408 21:27:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:53.408 21:27:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:53.408 21:27:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:53.408 21:27:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:53.408 21:27:47 -- nvmf/common.sh@58 -- # uname 00:26:53.408 21:27:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:53.408 21:27:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:53.408 21:27:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:53.668 21:27:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:53.668 21:27:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:53.668 21:27:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:53.668 21:27:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:53.668 21:27:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:53.668 21:27:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:53.668 21:27:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:53.668 21:27:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:53.668 21:27:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:53.668 21:27:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:53.668 21:27:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:53.668 21:27:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:53.668 21:27:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:53.668 21:27:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@105 -- # continue 2 00:26:53.668 21:27:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@105 -- # continue 2 00:26:53.668 21:27:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:53.668 21:27:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:53.668 21:27:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:53.668 21:27:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:53.668 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:53.668 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:53.668 altname enp24s0f0np0 00:26:53.668 altname ens785f0np0 00:26:53.668 inet 192.168.100.8/24 scope global mlx_0_0 00:26:53.668 valid_lft forever preferred_lft forever 00:26:53.668 21:27:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:53.668 21:27:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:53.668 21:27:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:53.668 21:27:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:53.668 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:53.668 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:53.668 altname enp24s0f1np1 00:26:53.668 altname ens785f1np1 00:26:53.668 inet 192.168.100.9/24 scope global mlx_0_1 00:26:53.668 valid_lft forever preferred_lft forever 00:26:53.668 21:27:47 -- nvmf/common.sh@411 -- # return 0 00:26:53.668 21:27:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:53.668 21:27:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:53.668 21:27:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:53.668 21:27:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:53.668 21:27:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:53.668 21:27:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:53.668 21:27:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:53.668 21:27:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:53.668 21:27:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:53.668 21:27:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@105 -- # continue 2 00:26:53.668 21:27:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:53.668 21:27:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:53.668 21:27:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@105 -- # continue 2 00:26:53.668 21:27:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:53.668 21:27:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:53.668 21:27:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:53.668 21:27:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:53.668 21:27:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:53.668 21:27:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:53.668 192.168.100.9' 00:26:53.668 21:27:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:53.668 192.168.100.9' 00:26:53.668 21:27:47 -- nvmf/common.sh@446 -- # head -n 1 00:26:53.668 21:27:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:53.668 21:27:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:53.668 192.168.100.9' 00:26:53.668 21:27:47 -- nvmf/common.sh@447 -- # tail -n +2 00:26:53.668 21:27:47 -- nvmf/common.sh@447 -- # head -n 1 00:26:53.668 21:27:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:53.668 21:27:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:53.668 21:27:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:53.668 21:27:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:53.668 21:27:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:53.668 21:27:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:53.668 21:27:47 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:53.668 21:27:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:53.668 21:27:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:53.668 21:27:47 -- common/autotest_common.sh@10 -- # set +x 00:26:53.668 21:27:47 -- nvmf/common.sh@470 -- # nvmfpid=1473528 00:26:53.668 21:27:47 -- nvmf/common.sh@471 -- # waitforlisten 1473528 00:26:53.669 21:27:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:53.669 21:27:47 -- common/autotest_common.sh@817 -- # '[' -z 1473528 ']' 00:26:53.669 21:27:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:53.669 21:27:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:53.669 21:27:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:53.669 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:53.669 21:27:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:53.669 21:27:47 -- common/autotest_common.sh@10 -- # set +x 00:26:53.669 [2024-04-23 21:27:47.905330] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:26:53.669 [2024-04-23 21:27:47.905370] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:53.669 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.928 [2024-04-23 21:27:47.960353] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:53.928 [2024-04-23 21:27:48.033793] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:53.928 [2024-04-23 21:27:48.033830] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:53.928 [2024-04-23 21:27:48.033836] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:53.928 [2024-04-23 21:27:48.033841] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:53.928 [2024-04-23 21:27:48.033846] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:53.928 [2024-04-23 21:27:48.033889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.928 [2024-04-23 21:27:48.033983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:53.928 [2024-04-23 21:27:48.034054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:53.928 [2024-04-23 21:27:48.034063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:54.496 21:27:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:54.496 21:27:48 -- common/autotest_common.sh@850 -- # return 0 00:26:54.496 21:27:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:54.496 21:27:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:54.496 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.496 21:27:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:54.496 21:27:48 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:54.496 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.496 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.496 [2024-04-23 21:27:48.749131] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1dd26b0/0x1dd6ba0) succeed. 00:26:54.496 [2024-04-23 21:27:48.758615] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1dd3cf0/0x1e18230) succeed. 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:54.754 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.754 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.754 Malloc0 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:54.754 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.754 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:54.754 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.754 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:26:54.754 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.754 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.754 [2024-04-23 21:27:48.914355] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:54.754 21:27:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:54.754 21:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:54.754 [2024-04-23 21:27:48.921995] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:54.754 [ 00:26:54.754 { 00:26:54.754 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:54.754 "subtype": "Discovery", 00:26:54.754 "listen_addresses": [], 00:26:54.754 "allow_any_host": true, 00:26:54.754 "hosts": [] 00:26:54.754 }, 00:26:54.754 { 00:26:54.754 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:54.754 "subtype": "NVMe", 00:26:54.754 "listen_addresses": [ 00:26:54.754 { 00:26:54.754 "transport": "RDMA", 00:26:54.754 "trtype": "RDMA", 00:26:54.754 "adrfam": "IPv4", 00:26:54.754 "traddr": "192.168.100.8", 00:26:54.754 "trsvcid": "4420" 00:26:54.754 } 00:26:54.754 ], 00:26:54.754 "allow_any_host": true, 00:26:54.754 "hosts": [], 00:26:54.754 "serial_number": "SPDK00000000000001", 00:26:54.754 "model_number": "SPDK bdev Controller", 00:26:54.754 "max_namespaces": 2, 00:26:54.754 "min_cntlid": 1, 00:26:54.754 "max_cntlid": 65519, 00:26:54.754 "namespaces": [ 00:26:54.754 { 00:26:54.754 "nsid": 1, 00:26:54.754 "bdev_name": "Malloc0", 00:26:54.754 "name": "Malloc0", 00:26:54.754 "nguid": "CDDFC6474E284A7082BAC943F5201805", 00:26:54.754 "uuid": "cddfc647-4e28-4a70-82ba-c943f5201805" 00:26:54.754 } 00:26:54.754 ] 00:26:54.754 } 00:26:54.754 ] 00:26:54.754 21:27:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:54.754 21:27:48 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:54.754 21:27:48 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:54.754 21:27:48 -- host/aer.sh@33 -- # aerpid=1473823 00:26:54.754 21:27:48 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:54.754 21:27:48 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:54.754 21:27:48 -- common/autotest_common.sh@1251 -- # local i=0 00:26:54.754 21:27:48 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:54.754 21:27:48 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:26:54.754 21:27:48 -- common/autotest_common.sh@1254 -- # i=1 00:26:54.754 21:27:48 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:26:54.754 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.012 21:27:49 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:55.012 21:27:49 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:26:55.012 21:27:49 -- common/autotest_common.sh@1254 -- # i=2 00:26:55.012 21:27:49 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:26:55.012 21:27:49 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:55.012 21:27:49 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:55.012 21:27:49 -- common/autotest_common.sh@1262 -- # return 0 00:26:55.012 21:27:49 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:55.012 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.012 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.012 Malloc1 00:26:55.012 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.012 21:27:49 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:55.012 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.012 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.012 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.012 21:27:49 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:55.012 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.012 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.012 [ 00:26:55.012 { 00:26:55.012 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:55.012 "subtype": "Discovery", 00:26:55.012 "listen_addresses": [], 00:26:55.012 "allow_any_host": true, 00:26:55.012 "hosts": [] 00:26:55.012 }, 00:26:55.012 { 00:26:55.012 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:55.012 "subtype": "NVMe", 00:26:55.012 "listen_addresses": [ 00:26:55.012 { 00:26:55.012 "transport": "RDMA", 00:26:55.012 "trtype": "RDMA", 00:26:55.012 "adrfam": "IPv4", 00:26:55.012 "traddr": "192.168.100.8", 00:26:55.012 "trsvcid": "4420" 00:26:55.012 } 00:26:55.012 ], 00:26:55.012 "allow_any_host": true, 00:26:55.012 "hosts": [], 00:26:55.012 "serial_number": "SPDK00000000000001", 00:26:55.012 "model_number": "SPDK bdev Controller", 00:26:55.012 "max_namespaces": 2, 00:26:55.012 "min_cntlid": 1, 00:26:55.012 "max_cntlid": 65519, 00:26:55.012 "namespaces": [ 00:26:55.012 { 00:26:55.012 "nsid": 1, 00:26:55.012 "bdev_name": "Malloc0", 00:26:55.012 "name": "Malloc0", 00:26:55.012 "nguid": "CDDFC6474E284A7082BAC943F5201805", 00:26:55.012 "uuid": "cddfc647-4e28-4a70-82ba-c943f5201805" 00:26:55.012 }, 00:26:55.012 { 00:26:55.012 "nsid": 2, 00:26:55.012 "bdev_name": "Malloc1", 00:26:55.012 "name": "Malloc1", 00:26:55.012 "nguid": "BD3341A0D5F54A2EAD671EA74A998823", 00:26:55.012 "uuid": "bd3341a0-d5f5-4a2e-ad67-1ea74a998823" 00:26:55.012 } 00:26:55.012 ] 00:26:55.012 } 00:26:55.012 ] 00:26:55.012 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.012 21:27:49 -- host/aer.sh@43 -- # wait 1473823 00:26:55.012 Asynchronous Event Request test 00:26:55.012 Attaching to 192.168.100.8 00:26:55.012 Attached to 192.168.100.8 00:26:55.012 Registering asynchronous event callbacks... 00:26:55.012 Starting namespace attribute notice tests for all controllers... 00:26:55.012 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:55.012 aer_cb - Changed Namespace 00:26:55.012 Cleaning up... 00:26:55.012 21:27:49 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:55.012 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.012 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.012 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.012 21:27:49 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:55.012 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.012 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.270 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.270 21:27:49 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:55.270 21:27:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:55.270 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.270 21:27:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:55.270 21:27:49 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:55.270 21:27:49 -- host/aer.sh@51 -- # nvmftestfini 00:26:55.270 21:27:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:55.270 21:27:49 -- nvmf/common.sh@117 -- # sync 00:26:55.270 21:27:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:55.270 21:27:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:55.270 21:27:49 -- nvmf/common.sh@120 -- # set +e 00:26:55.270 21:27:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:55.270 21:27:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:55.271 rmmod nvme_rdma 00:26:55.271 rmmod nvme_fabrics 00:26:55.271 21:27:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:55.271 21:27:49 -- nvmf/common.sh@124 -- # set -e 00:26:55.271 21:27:49 -- nvmf/common.sh@125 -- # return 0 00:26:55.271 21:27:49 -- nvmf/common.sh@478 -- # '[' -n 1473528 ']' 00:26:55.271 21:27:49 -- nvmf/common.sh@479 -- # killprocess 1473528 00:26:55.271 21:27:49 -- common/autotest_common.sh@936 -- # '[' -z 1473528 ']' 00:26:55.271 21:27:49 -- common/autotest_common.sh@940 -- # kill -0 1473528 00:26:55.271 21:27:49 -- common/autotest_common.sh@941 -- # uname 00:26:55.271 21:27:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:55.271 21:27:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1473528 00:26:55.271 21:27:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:55.271 21:27:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:55.271 21:27:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1473528' 00:26:55.271 killing process with pid 1473528 00:26:55.271 21:27:49 -- common/autotest_common.sh@955 -- # kill 1473528 00:26:55.271 [2024-04-23 21:27:49.381211] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:55.271 21:27:49 -- common/autotest_common.sh@960 -- # wait 1473528 00:26:55.271 [2024-04-23 21:27:49.454976] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:55.529 21:27:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:55.529 21:27:49 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:55.529 00:26:55.529 real 0m7.494s 00:26:55.529 user 0m7.872s 00:26:55.529 sys 0m4.675s 00:26:55.529 21:27:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:55.529 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.529 ************************************ 00:26:55.529 END TEST nvmf_aer 00:26:55.529 ************************************ 00:26:55.529 21:27:49 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:26:55.529 21:27:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:55.529 21:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:55.529 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.788 ************************************ 00:26:55.788 START TEST nvmf_async_init 00:26:55.788 ************************************ 00:26:55.788 21:27:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:26:55.788 * Looking for test storage... 00:26:55.788 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:26:55.788 21:27:49 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:55.788 21:27:49 -- nvmf/common.sh@7 -- # uname -s 00:26:55.788 21:27:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:55.788 21:27:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:55.788 21:27:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:55.788 21:27:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:55.788 21:27:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:55.788 21:27:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:55.788 21:27:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:55.788 21:27:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:55.788 21:27:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:55.788 21:27:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:55.788 21:27:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:55.788 21:27:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:55.788 21:27:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:55.788 21:27:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:55.788 21:27:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:55.788 21:27:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:55.788 21:27:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:55.788 21:27:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:55.788 21:27:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:55.788 21:27:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:55.788 21:27:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.788 21:27:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.788 21:27:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.788 21:27:49 -- paths/export.sh@5 -- # export PATH 00:26:55.788 21:27:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:55.788 21:27:49 -- nvmf/common.sh@47 -- # : 0 00:26:55.788 21:27:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:55.788 21:27:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:55.788 21:27:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:55.788 21:27:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:55.788 21:27:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:55.788 21:27:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:55.788 21:27:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:55.788 21:27:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:55.788 21:27:49 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:26:55.788 21:27:49 -- host/async_init.sh@14 -- # null_block_size=512 00:26:55.788 21:27:49 -- host/async_init.sh@15 -- # null_bdev=null0 00:26:55.788 21:27:49 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:26:55.788 21:27:49 -- host/async_init.sh@20 -- # uuidgen 00:26:55.788 21:27:49 -- host/async_init.sh@20 -- # tr -d - 00:26:55.788 21:27:49 -- host/async_init.sh@20 -- # nguid=2cb5518f4342406387b9c87ed88b3ea2 00:26:55.788 21:27:49 -- host/async_init.sh@22 -- # nvmftestinit 00:26:55.788 21:27:49 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:55.788 21:27:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:55.788 21:27:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:55.788 21:27:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:55.788 21:27:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:55.788 21:27:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:55.788 21:27:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:55.788 21:27:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:55.788 21:27:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:55.788 21:27:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:55.788 21:27:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:55.788 21:27:49 -- common/autotest_common.sh@10 -- # set +x 00:27:01.052 21:27:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:01.052 21:27:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:01.052 21:27:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:01.052 21:27:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:01.052 21:27:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:01.052 21:27:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:01.052 21:27:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:01.052 21:27:54 -- nvmf/common.sh@295 -- # net_devs=() 00:27:01.052 21:27:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:01.052 21:27:54 -- nvmf/common.sh@296 -- # e810=() 00:27:01.052 21:27:54 -- nvmf/common.sh@296 -- # local -ga e810 00:27:01.052 21:27:54 -- nvmf/common.sh@297 -- # x722=() 00:27:01.052 21:27:54 -- nvmf/common.sh@297 -- # local -ga x722 00:27:01.052 21:27:54 -- nvmf/common.sh@298 -- # mlx=() 00:27:01.052 21:27:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:01.052 21:27:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:01.052 21:27:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:01.052 21:27:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:01.052 21:27:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:01.052 21:27:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:01.053 21:27:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:01.053 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:01.053 21:27:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:01.053 21:27:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:01.053 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:01.053 21:27:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:01.053 21:27:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:01.053 21:27:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:01.053 21:27:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:01.053 Found net devices under 0000:18:00.0: mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:01.053 21:27:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:01.053 21:27:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:01.053 Found net devices under 0000:18:00.1: mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:01.053 21:27:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:01.053 21:27:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:01.053 21:27:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:01.053 21:27:54 -- nvmf/common.sh@58 -- # uname 00:27:01.053 21:27:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:01.053 21:27:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:01.053 21:27:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:01.053 21:27:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:01.053 21:27:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:01.053 21:27:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:01.053 21:27:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:01.053 21:27:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:01.053 21:27:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:01.053 21:27:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:01.053 21:27:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:01.053 21:27:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:01.053 21:27:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:01.053 21:27:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:01.053 21:27:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:01.053 21:27:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@105 -- # continue 2 00:27:01.053 21:27:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@105 -- # continue 2 00:27:01.053 21:27:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:01.053 21:27:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:01.053 21:27:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:01.053 21:27:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:01.053 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:01.053 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:01.053 altname enp24s0f0np0 00:27:01.053 altname ens785f0np0 00:27:01.053 inet 192.168.100.8/24 scope global mlx_0_0 00:27:01.053 valid_lft forever preferred_lft forever 00:27:01.053 21:27:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:01.053 21:27:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:01.053 21:27:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:01.053 21:27:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:01.053 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:01.053 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:01.053 altname enp24s0f1np1 00:27:01.053 altname ens785f1np1 00:27:01.053 inet 192.168.100.9/24 scope global mlx_0_1 00:27:01.053 valid_lft forever preferred_lft forever 00:27:01.053 21:27:54 -- nvmf/common.sh@411 -- # return 0 00:27:01.053 21:27:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:01.053 21:27:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:01.053 21:27:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:01.053 21:27:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:01.053 21:27:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:01.053 21:27:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:01.053 21:27:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:01.053 21:27:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:01.053 21:27:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:01.053 21:27:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@105 -- # continue 2 00:27:01.053 21:27:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:01.053 21:27:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:01.053 21:27:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@105 -- # continue 2 00:27:01.053 21:27:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:01.053 21:27:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:01.053 21:27:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:01.053 21:27:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:01.053 21:27:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:01.053 21:27:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:01.053 192.168.100.9' 00:27:01.053 21:27:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:01.053 192.168.100.9' 00:27:01.053 21:27:54 -- nvmf/common.sh@446 -- # head -n 1 00:27:01.053 21:27:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:01.053 21:27:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:01.053 192.168.100.9' 00:27:01.053 21:27:54 -- nvmf/common.sh@447 -- # tail -n +2 00:27:01.053 21:27:54 -- nvmf/common.sh@447 -- # head -n 1 00:27:01.053 21:27:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:01.053 21:27:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:01.053 21:27:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:01.053 21:27:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:01.053 21:27:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:01.054 21:27:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:01.054 21:27:54 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:27:01.054 21:27:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:01.054 21:27:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:01.054 21:27:54 -- common/autotest_common.sh@10 -- # set +x 00:27:01.054 21:27:54 -- nvmf/common.sh@470 -- # nvmfpid=1477186 00:27:01.054 21:27:54 -- nvmf/common.sh@471 -- # waitforlisten 1477186 00:27:01.054 21:27:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:27:01.054 21:27:54 -- common/autotest_common.sh@817 -- # '[' -z 1477186 ']' 00:27:01.054 21:27:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:01.054 21:27:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:01.054 21:27:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:01.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:01.054 21:27:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:01.054 21:27:54 -- common/autotest_common.sh@10 -- # set +x 00:27:01.054 [2024-04-23 21:27:55.031334] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:01.054 [2024-04-23 21:27:55.031376] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:01.054 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.054 [2024-04-23 21:27:55.081176] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:01.054 [2024-04-23 21:27:55.145038] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:01.054 [2024-04-23 21:27:55.145078] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:01.054 [2024-04-23 21:27:55.145085] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:01.054 [2024-04-23 21:27:55.145090] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:01.054 [2024-04-23 21:27:55.145094] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:01.054 [2024-04-23 21:27:55.145120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:01.622 21:27:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:01.622 21:27:55 -- common/autotest_common.sh@850 -- # return 0 00:27:01.622 21:27:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:01.622 21:27:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:01.622 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.622 21:27:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:01.622 21:27:55 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:01.622 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.622 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.622 [2024-04-23 21:27:55.860799] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1889510/0x188da00) succeed. 00:27:01.622 [2024-04-23 21:27:55.868839] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x188aa10/0x18cf090) succeed. 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 null0 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 2cb5518f4342406387b9c87ed88b3ea2 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 [2024-04-23 21:27:55.951038] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:01.882 21:27:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:55 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:27:01.882 21:27:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:55 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 nvme0n1 00:27:01.882 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.882 21:27:56 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:01.882 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.882 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.882 [ 00:27:01.882 { 00:27:01.882 "name": "nvme0n1", 00:27:01.882 "aliases": [ 00:27:01.882 "2cb5518f-4342-4063-87b9-c87ed88b3ea2" 00:27:01.882 ], 00:27:01.882 "product_name": "NVMe disk", 00:27:01.882 "block_size": 512, 00:27:01.882 "num_blocks": 2097152, 00:27:01.882 "uuid": "2cb5518f-4342-4063-87b9-c87ed88b3ea2", 00:27:01.882 "assigned_rate_limits": { 00:27:01.882 "rw_ios_per_sec": 0, 00:27:01.882 "rw_mbytes_per_sec": 0, 00:27:01.882 "r_mbytes_per_sec": 0, 00:27:01.882 "w_mbytes_per_sec": 0 00:27:01.882 }, 00:27:01.882 "claimed": false, 00:27:01.882 "zoned": false, 00:27:01.882 "supported_io_types": { 00:27:01.882 "read": true, 00:27:01.882 "write": true, 00:27:01.882 "unmap": false, 00:27:01.882 "write_zeroes": true, 00:27:01.882 "flush": true, 00:27:01.882 "reset": true, 00:27:01.882 "compare": true, 00:27:01.882 "compare_and_write": true, 00:27:01.882 "abort": true, 00:27:01.882 "nvme_admin": true, 00:27:01.882 "nvme_io": true 00:27:01.882 }, 00:27:01.882 "memory_domains": [ 00:27:01.882 { 00:27:01.882 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:01.882 "dma_device_type": 0 00:27:01.882 } 00:27:01.882 ], 00:27:01.882 "driver_specific": { 00:27:01.882 "nvme": [ 00:27:01.882 { 00:27:01.882 "trid": { 00:27:01.882 "trtype": "RDMA", 00:27:01.882 "adrfam": "IPv4", 00:27:01.882 "traddr": "192.168.100.8", 00:27:01.882 "trsvcid": "4420", 00:27:01.882 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:01.882 }, 00:27:01.882 "ctrlr_data": { 00:27:01.882 "cntlid": 1, 00:27:01.882 "vendor_id": "0x8086", 00:27:01.882 "model_number": "SPDK bdev Controller", 00:27:01.882 "serial_number": "00000000000000000000", 00:27:01.882 "firmware_revision": "24.05", 00:27:01.882 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:01.882 "oacs": { 00:27:01.882 "security": 0, 00:27:01.882 "format": 0, 00:27:01.882 "firmware": 0, 00:27:01.882 "ns_manage": 0 00:27:01.882 }, 00:27:01.882 "multi_ctrlr": true, 00:27:01.882 "ana_reporting": false 00:27:01.883 }, 00:27:01.883 "vs": { 00:27:01.883 "nvme_version": "1.3" 00:27:01.883 }, 00:27:01.883 "ns_data": { 00:27:01.883 "id": 1, 00:27:01.883 "can_share": true 00:27:01.883 } 00:27:01.883 } 00:27:01.883 ], 00:27:01.883 "mp_policy": "active_passive" 00:27:01.883 } 00:27:01.883 } 00:27:01.883 ] 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 [2024-04-23 21:27:56.043900] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:01.883 [2024-04-23 21:27:56.062297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:01.883 [2024-04-23 21:27:56.082295] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 [ 00:27:01.883 { 00:27:01.883 "name": "nvme0n1", 00:27:01.883 "aliases": [ 00:27:01.883 "2cb5518f-4342-4063-87b9-c87ed88b3ea2" 00:27:01.883 ], 00:27:01.883 "product_name": "NVMe disk", 00:27:01.883 "block_size": 512, 00:27:01.883 "num_blocks": 2097152, 00:27:01.883 "uuid": "2cb5518f-4342-4063-87b9-c87ed88b3ea2", 00:27:01.883 "assigned_rate_limits": { 00:27:01.883 "rw_ios_per_sec": 0, 00:27:01.883 "rw_mbytes_per_sec": 0, 00:27:01.883 "r_mbytes_per_sec": 0, 00:27:01.883 "w_mbytes_per_sec": 0 00:27:01.883 }, 00:27:01.883 "claimed": false, 00:27:01.883 "zoned": false, 00:27:01.883 "supported_io_types": { 00:27:01.883 "read": true, 00:27:01.883 "write": true, 00:27:01.883 "unmap": false, 00:27:01.883 "write_zeroes": true, 00:27:01.883 "flush": true, 00:27:01.883 "reset": true, 00:27:01.883 "compare": true, 00:27:01.883 "compare_and_write": true, 00:27:01.883 "abort": true, 00:27:01.883 "nvme_admin": true, 00:27:01.883 "nvme_io": true 00:27:01.883 }, 00:27:01.883 "memory_domains": [ 00:27:01.883 { 00:27:01.883 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:01.883 "dma_device_type": 0 00:27:01.883 } 00:27:01.883 ], 00:27:01.883 "driver_specific": { 00:27:01.883 "nvme": [ 00:27:01.883 { 00:27:01.883 "trid": { 00:27:01.883 "trtype": "RDMA", 00:27:01.883 "adrfam": "IPv4", 00:27:01.883 "traddr": "192.168.100.8", 00:27:01.883 "trsvcid": "4420", 00:27:01.883 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:01.883 }, 00:27:01.883 "ctrlr_data": { 00:27:01.883 "cntlid": 2, 00:27:01.883 "vendor_id": "0x8086", 00:27:01.883 "model_number": "SPDK bdev Controller", 00:27:01.883 "serial_number": "00000000000000000000", 00:27:01.883 "firmware_revision": "24.05", 00:27:01.883 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:01.883 "oacs": { 00:27:01.883 "security": 0, 00:27:01.883 "format": 0, 00:27:01.883 "firmware": 0, 00:27:01.883 "ns_manage": 0 00:27:01.883 }, 00:27:01.883 "multi_ctrlr": true, 00:27:01.883 "ana_reporting": false 00:27:01.883 }, 00:27:01.883 "vs": { 00:27:01.883 "nvme_version": "1.3" 00:27:01.883 }, 00:27:01.883 "ns_data": { 00:27:01.883 "id": 1, 00:27:01.883 "can_share": true 00:27:01.883 } 00:27:01.883 } 00:27:01.883 ], 00:27:01.883 "mp_policy": "active_passive" 00:27:01.883 } 00:27:01.883 } 00:27:01.883 ] 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@53 -- # mktemp 00:27:01.883 21:27:56 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.0pyKFNFmzs 00:27:01.883 21:27:56 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:27:01.883 21:27:56 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.0pyKFNFmzs 00:27:01.883 21:27:56 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 [2024-04-23 21:27:56.136628] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.0pyKFNFmzs 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:01.883 21:27:56 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.0pyKFNFmzs 00:27:01.883 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:01.883 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 [2024-04-23 21:27:56.152654] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:27:02.143 nvme0n1 00:27:02.143 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:02.143 21:27:56 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:02.143 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:02.143 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:02.143 [ 00:27:02.143 { 00:27:02.143 "name": "nvme0n1", 00:27:02.143 "aliases": [ 00:27:02.143 "2cb5518f-4342-4063-87b9-c87ed88b3ea2" 00:27:02.143 ], 00:27:02.143 "product_name": "NVMe disk", 00:27:02.143 "block_size": 512, 00:27:02.143 "num_blocks": 2097152, 00:27:02.143 "uuid": "2cb5518f-4342-4063-87b9-c87ed88b3ea2", 00:27:02.143 "assigned_rate_limits": { 00:27:02.143 "rw_ios_per_sec": 0, 00:27:02.143 "rw_mbytes_per_sec": 0, 00:27:02.143 "r_mbytes_per_sec": 0, 00:27:02.143 "w_mbytes_per_sec": 0 00:27:02.143 }, 00:27:02.143 "claimed": false, 00:27:02.143 "zoned": false, 00:27:02.143 "supported_io_types": { 00:27:02.143 "read": true, 00:27:02.143 "write": true, 00:27:02.143 "unmap": false, 00:27:02.143 "write_zeroes": true, 00:27:02.143 "flush": true, 00:27:02.143 "reset": true, 00:27:02.143 "compare": true, 00:27:02.143 "compare_and_write": true, 00:27:02.143 "abort": true, 00:27:02.143 "nvme_admin": true, 00:27:02.143 "nvme_io": true 00:27:02.143 }, 00:27:02.143 "memory_domains": [ 00:27:02.143 { 00:27:02.143 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:02.143 "dma_device_type": 0 00:27:02.143 } 00:27:02.143 ], 00:27:02.143 "driver_specific": { 00:27:02.143 "nvme": [ 00:27:02.143 { 00:27:02.143 "trid": { 00:27:02.143 "trtype": "RDMA", 00:27:02.143 "adrfam": "IPv4", 00:27:02.143 "traddr": "192.168.100.8", 00:27:02.143 "trsvcid": "4421", 00:27:02.143 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:02.143 }, 00:27:02.143 "ctrlr_data": { 00:27:02.143 "cntlid": 3, 00:27:02.143 "vendor_id": "0x8086", 00:27:02.143 "model_number": "SPDK bdev Controller", 00:27:02.143 "serial_number": "00000000000000000000", 00:27:02.143 "firmware_revision": "24.05", 00:27:02.143 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:02.143 "oacs": { 00:27:02.143 "security": 0, 00:27:02.143 "format": 0, 00:27:02.143 "firmware": 0, 00:27:02.143 "ns_manage": 0 00:27:02.143 }, 00:27:02.143 "multi_ctrlr": true, 00:27:02.143 "ana_reporting": false 00:27:02.143 }, 00:27:02.143 "vs": { 00:27:02.143 "nvme_version": "1.3" 00:27:02.143 }, 00:27:02.143 "ns_data": { 00:27:02.143 "id": 1, 00:27:02.143 "can_share": true 00:27:02.143 } 00:27:02.143 } 00:27:02.143 ], 00:27:02.143 "mp_policy": "active_passive" 00:27:02.143 } 00:27:02.143 } 00:27:02.143 ] 00:27:02.143 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:02.143 21:27:56 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:02.143 21:27:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:02.143 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:02.143 21:27:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:02.143 21:27:56 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.0pyKFNFmzs 00:27:02.143 21:27:56 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:27:02.143 21:27:56 -- host/async_init.sh@78 -- # nvmftestfini 00:27:02.143 21:27:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:02.143 21:27:56 -- nvmf/common.sh@117 -- # sync 00:27:02.143 21:27:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:02.143 21:27:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:02.143 21:27:56 -- nvmf/common.sh@120 -- # set +e 00:27:02.143 21:27:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:02.143 21:27:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:02.143 rmmod nvme_rdma 00:27:02.143 rmmod nvme_fabrics 00:27:02.143 21:27:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:02.143 21:27:56 -- nvmf/common.sh@124 -- # set -e 00:27:02.143 21:27:56 -- nvmf/common.sh@125 -- # return 0 00:27:02.143 21:27:56 -- nvmf/common.sh@478 -- # '[' -n 1477186 ']' 00:27:02.143 21:27:56 -- nvmf/common.sh@479 -- # killprocess 1477186 00:27:02.143 21:27:56 -- common/autotest_common.sh@936 -- # '[' -z 1477186 ']' 00:27:02.143 21:27:56 -- common/autotest_common.sh@940 -- # kill -0 1477186 00:27:02.143 21:27:56 -- common/autotest_common.sh@941 -- # uname 00:27:02.143 21:27:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:02.143 21:27:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1477186 00:27:02.143 21:27:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:02.143 21:27:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:02.143 21:27:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1477186' 00:27:02.143 killing process with pid 1477186 00:27:02.143 21:27:56 -- common/autotest_common.sh@955 -- # kill 1477186 00:27:02.143 21:27:56 -- common/autotest_common.sh@960 -- # wait 1477186 00:27:02.143 [2024-04-23 21:27:56.373006] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:02.403 21:27:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:02.403 21:27:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:02.403 00:27:02.403 real 0m6.751s 00:27:02.403 user 0m3.083s 00:27:02.403 sys 0m4.097s 00:27:02.403 21:27:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:02.403 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:02.403 ************************************ 00:27:02.403 END TEST nvmf_async_init 00:27:02.403 ************************************ 00:27:02.403 21:27:56 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:02.403 21:27:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:02.403 21:27:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:02.403 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:02.662 ************************************ 00:27:02.662 START TEST dma 00:27:02.662 ************************************ 00:27:02.662 21:27:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:02.662 * Looking for test storage... 00:27:02.662 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:02.663 21:27:56 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:02.663 21:27:56 -- nvmf/common.sh@7 -- # uname -s 00:27:02.663 21:27:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:02.663 21:27:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:02.663 21:27:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:02.663 21:27:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:02.663 21:27:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:02.663 21:27:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:02.663 21:27:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:02.663 21:27:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:02.663 21:27:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:02.663 21:27:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:02.663 21:27:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:02.663 21:27:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:02.663 21:27:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:02.663 21:27:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:02.663 21:27:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:02.663 21:27:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:02.663 21:27:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:02.663 21:27:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:02.663 21:27:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:02.663 21:27:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:02.663 21:27:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:02.663 21:27:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:02.663 21:27:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:02.663 21:27:56 -- paths/export.sh@5 -- # export PATH 00:27:02.663 21:27:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:02.663 21:27:56 -- nvmf/common.sh@47 -- # : 0 00:27:02.663 21:27:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:02.663 21:27:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:02.663 21:27:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:02.663 21:27:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:02.663 21:27:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:02.663 21:27:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:02.663 21:27:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:02.663 21:27:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:02.663 21:27:56 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:27:02.663 21:27:56 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:27:02.663 21:27:56 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:27:02.663 21:27:56 -- host/dma.sh@18 -- # subsystem=0 00:27:02.663 21:27:56 -- host/dma.sh@93 -- # nvmftestinit 00:27:02.663 21:27:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:02.663 21:27:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:02.663 21:27:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:02.663 21:27:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:02.663 21:27:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:02.663 21:27:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:02.663 21:27:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:02.663 21:27:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:02.663 21:27:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:02.663 21:27:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:02.663 21:27:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:02.663 21:27:56 -- common/autotest_common.sh@10 -- # set +x 00:27:07.936 21:28:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:07.936 21:28:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:07.936 21:28:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:07.936 21:28:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:07.936 21:28:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:07.936 21:28:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:07.936 21:28:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:07.936 21:28:01 -- nvmf/common.sh@295 -- # net_devs=() 00:27:07.936 21:28:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:07.936 21:28:01 -- nvmf/common.sh@296 -- # e810=() 00:27:07.936 21:28:01 -- nvmf/common.sh@296 -- # local -ga e810 00:27:07.936 21:28:01 -- nvmf/common.sh@297 -- # x722=() 00:27:07.936 21:28:01 -- nvmf/common.sh@297 -- # local -ga x722 00:27:07.936 21:28:01 -- nvmf/common.sh@298 -- # mlx=() 00:27:07.936 21:28:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:07.936 21:28:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:07.936 21:28:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:07.936 21:28:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:07.936 21:28:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:07.936 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:07.936 21:28:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:07.936 21:28:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:07.936 21:28:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:07.936 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:07.936 21:28:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:07.936 21:28:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:07.936 21:28:01 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:07.936 21:28:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:07.936 21:28:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:07.936 21:28:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:07.936 21:28:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:07.936 21:28:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:07.936 Found net devices under 0000:18:00.0: mlx_0_0 00:27:07.936 21:28:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:07.936 21:28:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:07.936 21:28:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:07.936 21:28:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:07.936 21:28:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:07.936 Found net devices under 0000:18:00.1: mlx_0_1 00:27:07.936 21:28:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:07.936 21:28:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:07.936 21:28:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:07.936 21:28:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:07.937 21:28:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:07.937 21:28:01 -- nvmf/common.sh@58 -- # uname 00:27:07.937 21:28:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:07.937 21:28:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:07.937 21:28:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:07.937 21:28:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:07.937 21:28:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:07.937 21:28:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:07.937 21:28:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:07.937 21:28:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:07.937 21:28:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:07.937 21:28:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:07.937 21:28:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:07.937 21:28:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:07.937 21:28:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:07.937 21:28:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:07.937 21:28:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:07.937 21:28:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:07.937 21:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@105 -- # continue 2 00:27:07.937 21:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@105 -- # continue 2 00:27:07.937 21:28:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:07.937 21:28:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:07.937 21:28:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:07.937 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:07.937 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:07.937 altname enp24s0f0np0 00:27:07.937 altname ens785f0np0 00:27:07.937 inet 192.168.100.8/24 scope global mlx_0_0 00:27:07.937 valid_lft forever preferred_lft forever 00:27:07.937 21:28:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:07.937 21:28:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:07.937 21:28:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:07.937 21:28:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:07.937 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:07.937 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:07.937 altname enp24s0f1np1 00:27:07.937 altname ens785f1np1 00:27:07.937 inet 192.168.100.9/24 scope global mlx_0_1 00:27:07.937 valid_lft forever preferred_lft forever 00:27:07.937 21:28:01 -- nvmf/common.sh@411 -- # return 0 00:27:07.937 21:28:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:07.937 21:28:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:07.937 21:28:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:07.937 21:28:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:07.937 21:28:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:07.937 21:28:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:07.937 21:28:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:07.937 21:28:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:07.937 21:28:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:07.937 21:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@105 -- # continue 2 00:27:07.937 21:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:07.937 21:28:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:07.937 21:28:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@105 -- # continue 2 00:27:07.937 21:28:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:07.937 21:28:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:07.937 21:28:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:07.937 21:28:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:07.937 21:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:07.937 21:28:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:07.937 192.168.100.9' 00:27:07.937 21:28:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:07.937 192.168.100.9' 00:27:07.937 21:28:01 -- nvmf/common.sh@446 -- # head -n 1 00:27:07.937 21:28:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:07.937 21:28:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:07.937 192.168.100.9' 00:27:07.937 21:28:01 -- nvmf/common.sh@447 -- # tail -n +2 00:27:07.937 21:28:01 -- nvmf/common.sh@447 -- # head -n 1 00:27:07.937 21:28:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:07.937 21:28:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:07.937 21:28:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:07.937 21:28:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:07.937 21:28:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:07.937 21:28:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:07.937 21:28:01 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:27:07.937 21:28:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:07.937 21:28:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:07.937 21:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:07.937 21:28:01 -- nvmf/common.sh@470 -- # nvmfpid=1480600 00:27:07.937 21:28:01 -- nvmf/common.sh@471 -- # waitforlisten 1480600 00:27:07.937 21:28:01 -- common/autotest_common.sh@817 -- # '[' -z 1480600 ']' 00:27:07.937 21:28:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:07.937 21:28:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:07.937 21:28:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:07.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:07.937 21:28:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:07.937 21:28:01 -- common/autotest_common.sh@10 -- # set +x 00:27:07.937 21:28:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:27:07.937 [2024-04-23 21:28:01.890133] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:07.937 [2024-04-23 21:28:01.890176] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:07.937 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.937 [2024-04-23 21:28:01.939357] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:07.937 [2024-04-23 21:28:02.010904] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:07.937 [2024-04-23 21:28:02.010938] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:07.937 [2024-04-23 21:28:02.010945] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:07.937 [2024-04-23 21:28:02.010950] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:07.937 [2024-04-23 21:28:02.010955] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:07.937 [2024-04-23 21:28:02.010995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.937 [2024-04-23 21:28:02.010997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:08.504 21:28:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:08.504 21:28:02 -- common/autotest_common.sh@850 -- # return 0 00:27:08.504 21:28:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:08.504 21:28:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:08.504 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.504 21:28:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:08.504 21:28:02 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:08.504 21:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.504 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.504 [2024-04-23 21:28:02.715648] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14b4050/0x14b8540) succeed. 00:27:08.504 [2024-04-23 21:28:02.723630] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14b5550/0x14f9bd0) succeed. 00:27:08.761 21:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.761 21:28:02 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:27:08.761 21:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.761 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.761 Malloc0 00:27:08.761 21:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.761 21:28:02 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:27:08.761 21:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.761 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.761 21:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.761 21:28:02 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:27:08.761 21:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.761 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.761 21:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.761 21:28:02 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:08.761 21:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.761 21:28:02 -- common/autotest_common.sh@10 -- # set +x 00:27:08.761 [2024-04-23 21:28:02.874437] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:08.761 21:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.761 21:28:02 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:27:08.761 21:28:02 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:27:08.761 21:28:02 -- nvmf/common.sh@521 -- # config=() 00:27:08.761 21:28:02 -- nvmf/common.sh@521 -- # local subsystem config 00:27:08.761 21:28:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:08.761 21:28:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:08.761 { 00:27:08.761 "params": { 00:27:08.761 "name": "Nvme$subsystem", 00:27:08.761 "trtype": "$TEST_TRANSPORT", 00:27:08.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:08.761 "adrfam": "ipv4", 00:27:08.761 "trsvcid": "$NVMF_PORT", 00:27:08.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:08.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:08.761 "hdgst": ${hdgst:-false}, 00:27:08.761 "ddgst": ${ddgst:-false} 00:27:08.761 }, 00:27:08.761 "method": "bdev_nvme_attach_controller" 00:27:08.761 } 00:27:08.761 EOF 00:27:08.761 )") 00:27:08.761 21:28:02 -- nvmf/common.sh@543 -- # cat 00:27:08.761 21:28:02 -- nvmf/common.sh@545 -- # jq . 00:27:08.761 21:28:02 -- nvmf/common.sh@546 -- # IFS=, 00:27:08.761 21:28:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:27:08.761 "params": { 00:27:08.761 "name": "Nvme0", 00:27:08.761 "trtype": "rdma", 00:27:08.761 "traddr": "192.168.100.8", 00:27:08.761 "adrfam": "ipv4", 00:27:08.761 "trsvcid": "4420", 00:27:08.761 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:08.761 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:08.761 "hdgst": false, 00:27:08.761 "ddgst": false 00:27:08.761 }, 00:27:08.761 "method": "bdev_nvme_attach_controller" 00:27:08.761 }' 00:27:08.761 [2024-04-23 21:28:02.917000] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:08.761 [2024-04-23 21:28:02.917041] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1480830 ] 00:27:08.761 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.761 [2024-04-23 21:28:02.963972] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:08.761 [2024-04-23 21:28:03.029378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:08.761 [2024-04-23 21:28:03.029381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:15.327 bdev Nvme0n1 reports 1 memory domains 00:27:15.327 bdev Nvme0n1 supports RDMA memory domain 00:27:15.327 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:15.327 ========================================================================== 00:27:15.327 Latency [us] 00:27:15.327 IOPS MiB/s Average min max 00:27:15.327 Core 2: 23300.68 91.02 686.03 231.46 8661.54 00:27:15.327 Core 3: 23405.28 91.43 682.92 216.15 8725.96 00:27:15.327 ========================================================================== 00:27:15.327 Total : 46705.96 182.45 684.47 216.15 8725.96 00:27:15.327 00:27:15.327 Total operations: 233549, translate 233549 pull_push 0 memzero 0 00:27:15.327 21:28:08 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:27:15.327 21:28:08 -- host/dma.sh@107 -- # gen_malloc_json 00:27:15.327 21:28:08 -- host/dma.sh@21 -- # jq . 00:27:15.327 [2024-04-23 21:28:08.457770] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:15.327 [2024-04-23 21:28:08.457820] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1481948 ] 00:27:15.327 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.327 [2024-04-23 21:28:08.504838] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:15.327 [2024-04-23 21:28:08.565584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:15.327 [2024-04-23 21:28:08.565586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:20.651 bdev Malloc0 reports 2 memory domains 00:27:20.651 bdev Malloc0 doesn't support RDMA memory domain 00:27:20.651 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:20.651 ========================================================================== 00:27:20.651 Latency [us] 00:27:20.651 IOPS MiB/s Average min max 00:27:20.651 Core 2: 15652.02 61.14 1021.54 369.47 1902.45 00:27:20.651 Core 3: 15863.14 61.97 1007.92 369.99 1871.25 00:27:20.651 ========================================================================== 00:27:20.651 Total : 31515.16 123.11 1014.68 369.47 1902.45 00:27:20.651 00:27:20.651 Total operations: 157632, translate 0 pull_push 630528 memzero 0 00:27:20.651 21:28:13 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:27:20.651 21:28:13 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:27:20.651 21:28:13 -- host/dma.sh@48 -- # local subsystem=0 00:27:20.651 21:28:13 -- host/dma.sh@50 -- # jq . 00:27:20.651 Ignoring -M option 00:27:20.651 [2024-04-23 21:28:13.924197] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:20.651 [2024-04-23 21:28:13.924239] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1482913 ] 00:27:20.651 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.651 [2024-04-23 21:28:13.972354] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:20.651 [2024-04-23 21:28:14.034333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:20.651 [2024-04-23 21:28:14.034333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:20.651 [2024-04-23 21:28:14.239325] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:25.924 [2024-04-23 21:28:19.266810] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:25.924 bdev 375eeff0-d29d-4cc6-8339-b1543e3212bd reports 1 memory domains 00:27:25.924 bdev 375eeff0-d29d-4cc6-8339-b1543e3212bd supports RDMA memory domain 00:27:25.924 Initialization complete, running randread IO for 5 sec on 2 cores 00:27:25.924 ========================================================================== 00:27:25.924 Latency [us] 00:27:25.924 IOPS MiB/s Average min max 00:27:25.924 Core 2: 85511.88 334.03 186.44 74.13 2751.63 00:27:25.924 Core 3: 88184.62 344.47 180.79 65.67 2692.59 00:27:25.924 ========================================================================== 00:27:25.924 Total : 173696.50 678.50 183.57 65.67 2751.63 00:27:25.924 00:27:25.924 Total operations: 868565, translate 0 pull_push 0 memzero 868565 00:27:25.924 21:28:19 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:27:25.924 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.924 [2024-04-23 21:28:19.574443] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:27:27.828 Initializing NVMe Controllers 00:27:27.828 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:27:27.828 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:27:27.828 Initialization complete. Launching workers. 00:27:27.828 ======================================================== 00:27:27.828 Latency(us) 00:27:27.828 Device Information : IOPS MiB/s Average min max 00:27:27.828 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7972.62 5962.91 8980.77 00:27:27.828 ======================================================== 00:27:27.828 Total : 2016.00 7.88 7972.62 5962.91 8980.77 00:27:27.828 00:27:27.828 21:28:21 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:27:27.828 21:28:21 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:27:27.828 21:28:21 -- host/dma.sh@48 -- # local subsystem=0 00:27:27.828 21:28:21 -- host/dma.sh@50 -- # jq . 00:27:27.828 [2024-04-23 21:28:21.894368] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:27.828 [2024-04-23 21:28:21.894412] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1484475 ] 00:27:27.828 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.828 [2024-04-23 21:28:21.940691] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:27.828 [2024-04-23 21:28:22.006288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.828 [2024-04-23 21:28:22.006290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:28.087 [2024-04-23 21:28:22.211454] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:33.361 [2024-04-23 21:28:27.238888] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:33.361 bdev 9b60183e-5b13-47b4-a550-c4dcc7618bce reports 1 memory domains 00:27:33.361 bdev 9b60183e-5b13-47b4-a550-c4dcc7618bce supports RDMA memory domain 00:27:33.361 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:33.361 ========================================================================== 00:27:33.361 Latency [us] 00:27:33.361 IOPS MiB/s Average min max 00:27:33.361 Core 2: 20547.84 80.26 778.00 45.79 11832.11 00:27:33.361 Core 3: 20924.60 81.74 763.99 14.49 11954.96 00:27:33.361 ========================================================================== 00:27:33.361 Total : 41472.44 162.00 770.93 14.49 11954.96 00:27:33.361 00:27:33.361 Total operations: 207382, translate 207274 pull_push 0 memzero 108 00:27:33.361 21:28:27 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:27:33.361 21:28:27 -- host/dma.sh@120 -- # nvmftestfini 00:27:33.361 21:28:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:33.361 21:28:27 -- nvmf/common.sh@117 -- # sync 00:27:33.361 21:28:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:33.361 21:28:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:33.361 21:28:27 -- nvmf/common.sh@120 -- # set +e 00:27:33.361 21:28:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:33.361 21:28:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:33.361 rmmod nvme_rdma 00:27:33.361 rmmod nvme_fabrics 00:27:33.361 21:28:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:33.361 21:28:27 -- nvmf/common.sh@124 -- # set -e 00:27:33.361 21:28:27 -- nvmf/common.sh@125 -- # return 0 00:27:33.361 21:28:27 -- nvmf/common.sh@478 -- # '[' -n 1480600 ']' 00:27:33.361 21:28:27 -- nvmf/common.sh@479 -- # killprocess 1480600 00:27:33.361 21:28:27 -- common/autotest_common.sh@936 -- # '[' -z 1480600 ']' 00:27:33.361 21:28:27 -- common/autotest_common.sh@940 -- # kill -0 1480600 00:27:33.361 21:28:27 -- common/autotest_common.sh@941 -- # uname 00:27:33.361 21:28:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:33.361 21:28:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1480600 00:27:33.361 21:28:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:33.361 21:28:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:33.361 21:28:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1480600' 00:27:33.361 killing process with pid 1480600 00:27:33.361 21:28:27 -- common/autotest_common.sh@955 -- # kill 1480600 00:27:33.361 21:28:27 -- common/autotest_common.sh@960 -- # wait 1480600 00:27:33.361 [2024-04-23 21:28:27.590614] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:33.619 21:28:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:33.619 21:28:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:33.619 00:27:33.619 real 0m31.124s 00:27:33.619 user 1m35.708s 00:27:33.619 sys 0m4.739s 00:27:33.619 21:28:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:33.619 21:28:27 -- common/autotest_common.sh@10 -- # set +x 00:27:33.619 ************************************ 00:27:33.619 END TEST dma 00:27:33.619 ************************************ 00:27:33.619 21:28:27 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:33.619 21:28:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:33.619 21:28:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:33.619 21:28:27 -- common/autotest_common.sh@10 -- # set +x 00:27:33.878 ************************************ 00:27:33.878 START TEST nvmf_identify 00:27:33.878 ************************************ 00:27:33.878 21:28:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:33.878 * Looking for test storage... 00:27:33.878 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:33.878 21:28:28 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:33.878 21:28:28 -- nvmf/common.sh@7 -- # uname -s 00:27:33.878 21:28:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:33.878 21:28:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:33.878 21:28:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:33.878 21:28:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:33.878 21:28:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:33.878 21:28:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:33.878 21:28:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:33.878 21:28:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:33.878 21:28:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:33.878 21:28:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:33.878 21:28:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:33.878 21:28:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:33.878 21:28:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:33.878 21:28:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:33.878 21:28:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:33.878 21:28:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:33.878 21:28:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:33.878 21:28:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:33.878 21:28:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:33.878 21:28:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:33.878 21:28:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.878 21:28:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.878 21:28:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.878 21:28:28 -- paths/export.sh@5 -- # export PATH 00:27:33.878 21:28:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.878 21:28:28 -- nvmf/common.sh@47 -- # : 0 00:27:33.878 21:28:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:33.878 21:28:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:33.878 21:28:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:33.878 21:28:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:33.878 21:28:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:33.879 21:28:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:33.879 21:28:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:33.879 21:28:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:33.879 21:28:28 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:33.879 21:28:28 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:33.879 21:28:28 -- host/identify.sh@14 -- # nvmftestinit 00:27:33.879 21:28:28 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:33.879 21:28:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:33.879 21:28:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:33.879 21:28:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:33.879 21:28:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:33.879 21:28:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:33.879 21:28:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:33.879 21:28:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:33.879 21:28:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:33.879 21:28:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:33.879 21:28:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:33.879 21:28:28 -- common/autotest_common.sh@10 -- # set +x 00:27:39.149 21:28:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:39.149 21:28:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:39.149 21:28:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:39.149 21:28:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:39.149 21:28:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:39.149 21:28:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:39.149 21:28:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:39.149 21:28:33 -- nvmf/common.sh@295 -- # net_devs=() 00:27:39.149 21:28:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:39.149 21:28:33 -- nvmf/common.sh@296 -- # e810=() 00:27:39.149 21:28:33 -- nvmf/common.sh@296 -- # local -ga e810 00:27:39.149 21:28:33 -- nvmf/common.sh@297 -- # x722=() 00:27:39.149 21:28:33 -- nvmf/common.sh@297 -- # local -ga x722 00:27:39.149 21:28:33 -- nvmf/common.sh@298 -- # mlx=() 00:27:39.149 21:28:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:39.149 21:28:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:39.149 21:28:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:39.149 21:28:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:39.149 21:28:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:39.150 21:28:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:39.150 21:28:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:39.150 21:28:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:39.150 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:39.150 21:28:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:39.150 21:28:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:39.150 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:39.150 21:28:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:39.150 21:28:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:39.150 21:28:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:39.150 21:28:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:39.150 Found net devices under 0000:18:00.0: mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:39.150 21:28:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:39.150 21:28:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:39.150 21:28:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:39.150 Found net devices under 0000:18:00.1: mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:39.150 21:28:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:39.150 21:28:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:39.150 21:28:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:39.150 21:28:33 -- nvmf/common.sh@58 -- # uname 00:27:39.150 21:28:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:39.150 21:28:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:39.150 21:28:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:39.150 21:28:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:39.150 21:28:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:39.150 21:28:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:39.150 21:28:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:39.150 21:28:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:39.150 21:28:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:39.150 21:28:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:39.150 21:28:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:39.150 21:28:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:39.150 21:28:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:39.150 21:28:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:39.150 21:28:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:39.150 21:28:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@105 -- # continue 2 00:27:39.150 21:28:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@105 -- # continue 2 00:27:39.150 21:28:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:39.150 21:28:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:39.150 21:28:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:39.150 21:28:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:39.150 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:39.150 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:39.150 altname enp24s0f0np0 00:27:39.150 altname ens785f0np0 00:27:39.150 inet 192.168.100.8/24 scope global mlx_0_0 00:27:39.150 valid_lft forever preferred_lft forever 00:27:39.150 21:28:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:39.150 21:28:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:39.150 21:28:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:39.150 21:28:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:39.150 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:39.150 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:39.150 altname enp24s0f1np1 00:27:39.150 altname ens785f1np1 00:27:39.150 inet 192.168.100.9/24 scope global mlx_0_1 00:27:39.150 valid_lft forever preferred_lft forever 00:27:39.150 21:28:33 -- nvmf/common.sh@411 -- # return 0 00:27:39.150 21:28:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:39.150 21:28:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:39.150 21:28:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:39.150 21:28:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:39.150 21:28:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:39.150 21:28:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:39.150 21:28:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:39.150 21:28:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:39.150 21:28:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:39.150 21:28:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@105 -- # continue 2 00:27:39.150 21:28:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:39.150 21:28:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:39.150 21:28:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@105 -- # continue 2 00:27:39.150 21:28:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:39.150 21:28:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:39.150 21:28:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:39.150 21:28:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:39.150 21:28:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:39.150 21:28:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:39.150 192.168.100.9' 00:27:39.150 21:28:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:39.150 192.168.100.9' 00:27:39.150 21:28:33 -- nvmf/common.sh@446 -- # head -n 1 00:27:39.150 21:28:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:39.150 21:28:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:39.150 192.168.100.9' 00:27:39.150 21:28:33 -- nvmf/common.sh@447 -- # tail -n +2 00:27:39.150 21:28:33 -- nvmf/common.sh@447 -- # head -n 1 00:27:39.150 21:28:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:39.150 21:28:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:39.150 21:28:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:39.150 21:28:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:39.150 21:28:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:39.150 21:28:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:39.410 21:28:33 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:27:39.410 21:28:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:39.410 21:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:39.410 21:28:33 -- host/identify.sh@19 -- # nvmfpid=1488834 00:27:39.410 21:28:33 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:39.410 21:28:33 -- host/identify.sh@23 -- # waitforlisten 1488834 00:27:39.410 21:28:33 -- common/autotest_common.sh@817 -- # '[' -z 1488834 ']' 00:27:39.410 21:28:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:39.410 21:28:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:39.410 21:28:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:39.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:39.410 21:28:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:39.410 21:28:33 -- common/autotest_common.sh@10 -- # set +x 00:27:39.410 21:28:33 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:39.410 [2024-04-23 21:28:33.476251] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:39.410 [2024-04-23 21:28:33.476309] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:39.410 EAL: No free 2048 kB hugepages reported on node 1 00:27:39.410 [2024-04-23 21:28:33.528111] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:39.410 [2024-04-23 21:28:33.601861] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:39.410 [2024-04-23 21:28:33.601893] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:39.410 [2024-04-23 21:28:33.601899] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:39.410 [2024-04-23 21:28:33.601905] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:39.410 [2024-04-23 21:28:33.601910] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:39.410 [2024-04-23 21:28:33.601950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:39.410 [2024-04-23 21:28:33.601966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:39.410 [2024-04-23 21:28:33.602060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:39.410 [2024-04-23 21:28:33.602062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:40.351 21:28:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:40.351 21:28:34 -- common/autotest_common.sh@850 -- # return 0 00:27:40.351 21:28:34 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 [2024-04-23 21:28:34.286563] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x68e6b0/0x692ba0) succeed. 00:27:40.351 [2024-04-23 21:28:34.296094] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x68fcf0/0x6d4230) succeed. 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:27:40.351 21:28:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 21:28:34 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 Malloc0 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 [2024-04-23 21:28:34.485637] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:27:40.351 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.351 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.351 [2024-04-23 21:28:34.501367] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:40.351 [ 00:27:40.351 { 00:27:40.351 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:40.351 "subtype": "Discovery", 00:27:40.351 "listen_addresses": [ 00:27:40.351 { 00:27:40.351 "transport": "RDMA", 00:27:40.351 "trtype": "RDMA", 00:27:40.351 "adrfam": "IPv4", 00:27:40.351 "traddr": "192.168.100.8", 00:27:40.351 "trsvcid": "4420" 00:27:40.351 } 00:27:40.351 ], 00:27:40.351 "allow_any_host": true, 00:27:40.351 "hosts": [] 00:27:40.351 }, 00:27:40.351 { 00:27:40.351 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:40.351 "subtype": "NVMe", 00:27:40.351 "listen_addresses": [ 00:27:40.351 { 00:27:40.351 "transport": "RDMA", 00:27:40.351 "trtype": "RDMA", 00:27:40.351 "adrfam": "IPv4", 00:27:40.351 "traddr": "192.168.100.8", 00:27:40.351 "trsvcid": "4420" 00:27:40.351 } 00:27:40.351 ], 00:27:40.351 "allow_any_host": true, 00:27:40.351 "hosts": [], 00:27:40.351 "serial_number": "SPDK00000000000001", 00:27:40.351 "model_number": "SPDK bdev Controller", 00:27:40.351 "max_namespaces": 32, 00:27:40.351 "min_cntlid": 1, 00:27:40.351 "max_cntlid": 65519, 00:27:40.351 "namespaces": [ 00:27:40.351 { 00:27:40.351 "nsid": 1, 00:27:40.351 "bdev_name": "Malloc0", 00:27:40.351 "name": "Malloc0", 00:27:40.351 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:27:40.351 "eui64": "ABCDEF0123456789", 00:27:40.351 "uuid": "8b78957a-47e4-4569-9e82-e7f14feb9341" 00:27:40.351 } 00:27:40.351 ] 00:27:40.351 } 00:27:40.351 ] 00:27:40.351 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.351 21:28:34 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:27:40.351 [2024-04-23 21:28:34.537102] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:40.351 [2024-04-23 21:28:34.537144] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1488966 ] 00:27:40.351 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.351 [2024-04-23 21:28:34.577436] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:27:40.351 [2024-04-23 21:28:34.577515] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:27:40.351 [2024-04-23 21:28:34.577528] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:27:40.351 [2024-04-23 21:28:34.577531] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:27:40.351 [2024-04-23 21:28:34.577557] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:27:40.351 [2024-04-23 21:28:34.587811] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:27:40.351 [2024-04-23 21:28:34.597503] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:40.351 [2024-04-23 21:28:34.597513] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:27:40.351 [2024-04-23 21:28:34.597519] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.351 [2024-04-23 21:28:34.597524] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597528] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597532] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597536] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597540] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597544] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597548] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597551] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597555] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597559] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597563] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597567] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597570] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597574] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597578] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597582] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597586] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597590] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597594] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597598] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597601] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597605] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597609] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597615] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597619] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597623] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597627] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597630] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597634] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597638] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597642] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:27:40.352 [2024-04-23 21:28:34.597646] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:40.352 [2024-04-23 21:28:34.597649] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:27:40.352 [2024-04-23 21:28:34.597666] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.597677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x184800 00:27:40.352 [2024-04-23 21:28:34.603284] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603298] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603305] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:40.352 [2024-04-23 21:28:34.603310] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603315] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603330] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603357] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603368] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603372] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603376] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603381] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603402] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603411] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603416] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603421] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603426] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603431] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603444] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603452] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603455] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603461] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603467] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603483] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603490] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:27:40.352 [2024-04-23 21:28:34.603494] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603497] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603502] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603606] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:27:40.352 [2024-04-23 21:28:34.603610] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603618] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603623] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603637] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603645] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:40.352 [2024-04-23 21:28:34.603649] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603654] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603659] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.352 [2024-04-23 21:28:34.603676] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.352 [2024-04-23 21:28:34.603682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.352 [2024-04-23 21:28:34.603686] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:40.352 [2024-04-23 21:28:34.603689] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:27:40.352 [2024-04-23 21:28:34.603693] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603697] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:27:40.352 [2024-04-23 21:28:34.603703] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:27:40.352 [2024-04-23 21:28:34.603711] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.352 [2024-04-23 21:28:34.603716] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x184800 00:27:40.352 [2024-04-23 21:28:34.603750] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.603754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.603761] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:27:40.353 [2024-04-23 21:28:34.603764] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:27:40.353 [2024-04-23 21:28:34.603767] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:27:40.353 [2024-04-23 21:28:34.603773] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:27:40.353 [2024-04-23 21:28:34.603777] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:27:40.353 [2024-04-23 21:28:34.603780] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:27:40.353 [2024-04-23 21:28:34.603784] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603789] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:27:40.353 [2024-04-23 21:28:34.603795] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603800] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.353 [2024-04-23 21:28:34.603819] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.603823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.603829] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.353 [2024-04-23 21:28:34.603838] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.353 [2024-04-23 21:28:34.603847] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603853] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.353 [2024-04-23 21:28:34.603858] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.353 [2024-04-23 21:28:34.603866] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:27:40.353 [2024-04-23 21:28:34.603869] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603876] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:40.353 [2024-04-23 21:28:34.603882] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603887] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.353 [2024-04-23 21:28:34.603904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.603908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.603912] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:27:40.353 [2024-04-23 21:28:34.603917] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:27:40.353 [2024-04-23 21:28:34.603920] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603927] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x184800 00:27:40.353 [2024-04-23 21:28:34.603955] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.603959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.603963] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603970] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:27:40.353 [2024-04-23 21:28:34.603986] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.603992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x184800 00:27:40.353 [2024-04-23 21:28:34.603997] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604001] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.353 [2024-04-23 21:28:34.604021] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.604025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.604033] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x184800 00:27:40.353 [2024-04-23 21:28:34.604043] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604047] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.604051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.604054] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604070] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.604074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.604081] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x184800 00:27:40.353 [2024-04-23 21:28:34.604090] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.353 [2024-04-23 21:28:34.604105] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.353 [2024-04-23 21:28:34.604109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:27:40.353 [2024-04-23 21:28:34.604117] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.353 ===================================================== 00:27:40.353 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:27:40.353 ===================================================== 00:27:40.353 Controller Capabilities/Features 00:27:40.353 ================================ 00:27:40.353 Vendor ID: 0000 00:27:40.353 Subsystem Vendor ID: 0000 00:27:40.353 Serial Number: .................... 00:27:40.353 Model Number: ........................................ 00:27:40.353 Firmware Version: 24.05 00:27:40.353 Recommended Arb Burst: 0 00:27:40.353 IEEE OUI Identifier: 00 00 00 00:27:40.353 Multi-path I/O 00:27:40.353 May have multiple subsystem ports: No 00:27:40.353 May have multiple controllers: No 00:27:40.353 Associated with SR-IOV VF: No 00:27:40.353 Max Data Transfer Size: 131072 00:27:40.353 Max Number of Namespaces: 0 00:27:40.353 Max Number of I/O Queues: 1024 00:27:40.353 NVMe Specification Version (VS): 1.3 00:27:40.353 NVMe Specification Version (Identify): 1.3 00:27:40.353 Maximum Queue Entries: 128 00:27:40.353 Contiguous Queues Required: Yes 00:27:40.353 Arbitration Mechanisms Supported 00:27:40.353 Weighted Round Robin: Not Supported 00:27:40.353 Vendor Specific: Not Supported 00:27:40.353 Reset Timeout: 15000 ms 00:27:40.353 Doorbell Stride: 4 bytes 00:27:40.353 NVM Subsystem Reset: Not Supported 00:27:40.353 Command Sets Supported 00:27:40.353 NVM Command Set: Supported 00:27:40.353 Boot Partition: Not Supported 00:27:40.353 Memory Page Size Minimum: 4096 bytes 00:27:40.353 Memory Page Size Maximum: 4096 bytes 00:27:40.353 Persistent Memory Region: Not Supported 00:27:40.353 Optional Asynchronous Events Supported 00:27:40.353 Namespace Attribute Notices: Not Supported 00:27:40.353 Firmware Activation Notices: Not Supported 00:27:40.353 ANA Change Notices: Not Supported 00:27:40.353 PLE Aggregate Log Change Notices: Not Supported 00:27:40.353 LBA Status Info Alert Notices: Not Supported 00:27:40.353 EGE Aggregate Log Change Notices: Not Supported 00:27:40.353 Normal NVM Subsystem Shutdown event: Not Supported 00:27:40.353 Zone Descriptor Change Notices: Not Supported 00:27:40.353 Discovery Log Change Notices: Supported 00:27:40.353 Controller Attributes 00:27:40.353 128-bit Host Identifier: Not Supported 00:27:40.353 Non-Operational Permissive Mode: Not Supported 00:27:40.353 NVM Sets: Not Supported 00:27:40.353 Read Recovery Levels: Not Supported 00:27:40.353 Endurance Groups: Not Supported 00:27:40.353 Predictable Latency Mode: Not Supported 00:27:40.353 Traffic Based Keep ALive: Not Supported 00:27:40.353 Namespace Granularity: Not Supported 00:27:40.353 SQ Associations: Not Supported 00:27:40.353 UUID List: Not Supported 00:27:40.353 Multi-Domain Subsystem: Not Supported 00:27:40.353 Fixed Capacity Management: Not Supported 00:27:40.353 Variable Capacity Management: Not Supported 00:27:40.353 Delete Endurance Group: Not Supported 00:27:40.353 Delete NVM Set: Not Supported 00:27:40.353 Extended LBA Formats Supported: Not Supported 00:27:40.353 Flexible Data Placement Supported: Not Supported 00:27:40.353 00:27:40.354 Controller Memory Buffer Support 00:27:40.354 ================================ 00:27:40.354 Supported: No 00:27:40.354 00:27:40.354 Persistent Memory Region Support 00:27:40.354 ================================ 00:27:40.354 Supported: No 00:27:40.354 00:27:40.354 Admin Command Set Attributes 00:27:40.354 ============================ 00:27:40.354 Security Send/Receive: Not Supported 00:27:40.354 Format NVM: Not Supported 00:27:40.354 Firmware Activate/Download: Not Supported 00:27:40.354 Namespace Management: Not Supported 00:27:40.354 Device Self-Test: Not Supported 00:27:40.354 Directives: Not Supported 00:27:40.354 NVMe-MI: Not Supported 00:27:40.354 Virtualization Management: Not Supported 00:27:40.354 Doorbell Buffer Config: Not Supported 00:27:40.354 Get LBA Status Capability: Not Supported 00:27:40.354 Command & Feature Lockdown Capability: Not Supported 00:27:40.354 Abort Command Limit: 1 00:27:40.354 Async Event Request Limit: 4 00:27:40.354 Number of Firmware Slots: N/A 00:27:40.354 Firmware Slot 1 Read-Only: N/A 00:27:40.354 Firmware Activation Without Reset: N/A 00:27:40.354 Multiple Update Detection Support: N/A 00:27:40.354 Firmware Update Granularity: No Information Provided 00:27:40.354 Per-Namespace SMART Log: No 00:27:40.354 Asymmetric Namespace Access Log Page: Not Supported 00:27:40.354 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:27:40.354 Command Effects Log Page: Not Supported 00:27:40.354 Get Log Page Extended Data: Supported 00:27:40.354 Telemetry Log Pages: Not Supported 00:27:40.354 Persistent Event Log Pages: Not Supported 00:27:40.354 Supported Log Pages Log Page: May Support 00:27:40.354 Commands Supported & Effects Log Page: Not Supported 00:27:40.354 Feature Identifiers & Effects Log Page:May Support 00:27:40.354 NVMe-MI Commands & Effects Log Page: May Support 00:27:40.354 Data Area 4 for Telemetry Log: Not Supported 00:27:40.354 Error Log Page Entries Supported: 128 00:27:40.354 Keep Alive: Not Supported 00:27:40.354 00:27:40.354 NVM Command Set Attributes 00:27:40.354 ========================== 00:27:40.354 Submission Queue Entry Size 00:27:40.354 Max: 1 00:27:40.354 Min: 1 00:27:40.354 Completion Queue Entry Size 00:27:40.354 Max: 1 00:27:40.354 Min: 1 00:27:40.354 Number of Namespaces: 0 00:27:40.354 Compare Command: Not Supported 00:27:40.354 Write Uncorrectable Command: Not Supported 00:27:40.354 Dataset Management Command: Not Supported 00:27:40.354 Write Zeroes Command: Not Supported 00:27:40.354 Set Features Save Field: Not Supported 00:27:40.354 Reservations: Not Supported 00:27:40.354 Timestamp: Not Supported 00:27:40.354 Copy: Not Supported 00:27:40.354 Volatile Write Cache: Not Present 00:27:40.354 Atomic Write Unit (Normal): 1 00:27:40.354 Atomic Write Unit (PFail): 1 00:27:40.354 Atomic Compare & Write Unit: 1 00:27:40.354 Fused Compare & Write: Supported 00:27:40.354 Scatter-Gather List 00:27:40.354 SGL Command Set: Supported 00:27:40.354 SGL Keyed: Supported 00:27:40.354 SGL Bit Bucket Descriptor: Not Supported 00:27:40.354 SGL Metadata Pointer: Not Supported 00:27:40.354 Oversized SGL: Not Supported 00:27:40.354 SGL Metadata Address: Not Supported 00:27:40.354 SGL Offset: Supported 00:27:40.354 Transport SGL Data Block: Not Supported 00:27:40.354 Replay Protected Memory Block: Not Supported 00:27:40.354 00:27:40.354 Firmware Slot Information 00:27:40.354 ========================= 00:27:40.354 Active slot: 0 00:27:40.354 00:27:40.354 00:27:40.354 Error Log 00:27:40.354 ========= 00:27:40.354 00:27:40.354 Active Namespaces 00:27:40.354 ================= 00:27:40.354 Discovery Log Page 00:27:40.354 ================== 00:27:40.354 Generation Counter: 2 00:27:40.354 Number of Records: 2 00:27:40.354 Record Format: 0 00:27:40.354 00:27:40.354 Discovery Log Entry 0 00:27:40.354 ---------------------- 00:27:40.354 Transport Type: 1 (RDMA) 00:27:40.354 Address Family: 1 (IPv4) 00:27:40.354 Subsystem Type: 3 (Current Discovery Subsystem) 00:27:40.354 Entry Flags: 00:27:40.354 Duplicate Returned Information: 1 00:27:40.354 Explicit Persistent Connection Support for Discovery: 1 00:27:40.354 Transport Requirements: 00:27:40.354 Secure Channel: Not Required 00:27:40.354 Port ID: 0 (0x0000) 00:27:40.354 Controller ID: 65535 (0xffff) 00:27:40.354 Admin Max SQ Size: 128 00:27:40.354 Transport Service Identifier: 4420 00:27:40.354 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:27:40.354 Transport Address: 192.168.100.8 00:27:40.354 Transport Specific Address Subtype - RDMA 00:27:40.354 RDMA QP Service Type: 1 (Reliable Connected) 00:27:40.354 RDMA Provider Type: 1 (No provider specified) 00:27:40.354 RDMA CM Service: 1 (RDMA_CM) 00:27:40.354 Discovery Log Entry 1 00:27:40.354 ---------------------- 00:27:40.354 Transport Type: 1 (RDMA) 00:27:40.354 Address Family: 1 (IPv4) 00:27:40.354 Subsystem Type: 2 (NVM Subsystem) 00:27:40.354 Entry Flags: 00:27:40.354 Duplicate Returned Information: 0 00:27:40.354 Explicit Persistent Connection Support for Discovery: 0 00:27:40.354 Transport Requirements: 00:27:40.354 Secure Channel: Not Required 00:27:40.354 Port ID: 0 (0x0000) 00:27:40.354 Controller ID: 65535 (0xffff) 00:27:40.354 Admin Max SQ Size: [2024-04-23 21:28:34.604178] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:27:40.354 [2024-04-23 21:28:34.604185] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 49911 doesn't match qid 00:27:40.354 [2024-04-23 21:28:34.604196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32714 cdw0:5 sqhd:2790 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604201] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 49911 doesn't match qid 00:27:40.354 [2024-04-23 21:28:34.604206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32714 cdw0:5 sqhd:2790 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604210] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 49911 doesn't match qid 00:27:40.354 [2024-04-23 21:28:34.604215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32714 cdw0:5 sqhd:2790 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604220] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 49911 doesn't match qid 00:27:40.354 [2024-04-23 21:28:34.604225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32714 cdw0:5 sqhd:2790 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604232] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.354 [2024-04-23 21:28:34.604255] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.354 [2024-04-23 21:28:34.604259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604267] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604272] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.354 [2024-04-23 21:28:34.604282] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604303] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.354 [2024-04-23 21:28:34.604307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604312] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:27:40.354 [2024-04-23 21:28:34.604315] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:27:40.354 [2024-04-23 21:28:34.604319] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604325] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604331] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.354 [2024-04-23 21:28:34.604349] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.354 [2024-04-23 21:28:34.604353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604357] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604363] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604368] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.354 [2024-04-23 21:28:34.604386] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.354 [2024-04-23 21:28:34.604390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:40.354 [2024-04-23 21:28:34.604394] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604400] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.354 [2024-04-23 21:28:34.604406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.354 [2024-04-23 21:28:34.604425] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.354 [2024-04-23 21:28:34.604430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604434] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604441] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604446] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604461] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604469] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604476] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604498] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604506] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604513] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604519] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604533] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604542] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604548] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604571] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604581] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604588] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604612] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604622] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604628] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604634] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604653] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604661] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604667] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604673] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604686] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604694] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604700] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604706] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604727] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604735] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604743] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604748] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604770] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604778] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604784] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604805] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604813] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604819] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604843] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604851] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604857] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604883] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604891] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604897] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604902] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604919] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604926] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604932] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604938] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604954] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.604964] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604970] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.604975] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.604992] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.604996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:40.355 [2024-04-23 21:28:34.605000] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.605006] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.355 [2024-04-23 21:28:34.605011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.355 [2024-04-23 21:28:34.605026] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.355 [2024-04-23 21:28:34.605029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605033] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605040] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605060] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605067] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605073] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605079] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605093] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605101] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605107] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605112] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605134] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605142] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605148] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605153] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605168] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605177] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605184] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605189] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605204] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605212] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605219] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605224] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605243] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605251] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605256] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605262] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605291] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605297] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605302] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605318] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605326] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605332] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605355] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605363] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605369] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605374] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605395] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605404] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605410] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605415] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605435] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605442] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605448] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605453] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605474] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605482] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605488] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605509] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605517] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605542] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605549] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605555] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605561] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605581] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605589] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605595] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605600] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.357 [2024-04-23 21:28:34.605619] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.357 [2024-04-23 21:28:34.605623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:40.357 [2024-04-23 21:28:34.605627] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605633] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.357 [2024-04-23 21:28:34.605638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605652] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605660] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605666] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605671] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605684] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605698] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605704] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605725] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605733] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605739] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605745] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605764] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605771] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605777] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605783] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605803] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605811] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605817] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605837] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605845] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605851] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605856] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605869] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605878] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605884] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605889] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605907] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605914] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605920] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605926] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605946] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605954] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605960] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605965] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.605983] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.605987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.605990] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.605997] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606002] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606021] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606029] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606035] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606040] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606058] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606066] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606072] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606077] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606096] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606104] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606110] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606115] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606137] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606145] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606151] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606156] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606181] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606187] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606210] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606218] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606224] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606248] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606256] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606262] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606269] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.358 [2024-04-23 21:28:34.606286] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.358 [2024-04-23 21:28:34.606290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:40.358 [2024-04-23 21:28:34.606294] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.358 [2024-04-23 21:28:34.606300] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606323] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606331] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606337] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606363] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606371] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606376] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606399] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606408] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606414] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606419] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606431] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606439] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606445] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606451] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606471] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606478] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606484] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606492] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606513] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606521] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606527] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606532] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606553] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606560] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606566] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606572] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606585] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606593] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606599] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606604] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606619] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606627] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606633] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606652] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606659] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606665] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606671] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606686] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606694] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606701] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606706] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606728] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606736] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606742] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606763] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606771] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606778] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606783] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606799] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606807] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606813] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606837] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606845] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606851] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606856] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606870] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606878] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606884] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606889] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606908] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606916] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606923] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606928] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.359 [2024-04-23 21:28:34.606946] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.359 [2024-04-23 21:28:34.606950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:40.359 [2024-04-23 21:28:34.606953] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606959] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.359 [2024-04-23 21:28:34.606965] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.606980] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.606983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.606987] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.606993] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.606998] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607020] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607028] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607033] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607057] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607064] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607070] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607075] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607094] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607102] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607108] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607113] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607136] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607145] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607151] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607156] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607175] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607183] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607189] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607210] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607218] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607224] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.607249] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.607253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.607257] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607263] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.607268] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.611281] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.611287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.611291] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.611298] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.611303] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.360 [2024-04-23 21:28:34.611318] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.360 [2024-04-23 21:28:34.611322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0002 p:0 m:0 dnr:0 00:27:40.360 [2024-04-23 21:28:34.611326] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.360 [2024-04-23 21:28:34.611331] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:27:40.626 128 00:27:40.626 Transport Service Identifier: 4420 00:27:40.626 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:27:40.626 Transport Address: 192.168.100.8 00:27:40.626 Transport Specific Address Subtype - RDMA 00:27:40.626 RDMA QP Service Type: 1 (Reliable Connected) 00:27:40.626 RDMA Provider Type: 1 (No provider specified) 00:27:40.626 RDMA CM Service: 1 (RDMA_CM) 00:27:40.626 21:28:34 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:27:40.626 [2024-04-23 21:28:34.675683] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:40.626 [2024-04-23 21:28:34.675716] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1488990 ] 00:27:40.626 EAL: No free 2048 kB hugepages reported on node 1 00:27:40.626 [2024-04-23 21:28:34.713700] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:27:40.626 [2024-04-23 21:28:34.713764] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:27:40.626 [2024-04-23 21:28:34.713776] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:27:40.626 [2024-04-23 21:28:34.713779] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:27:40.626 [2024-04-23 21:28:34.713798] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:27:40.626 [2024-04-23 21:28:34.722717] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:27:40.626 [2024-04-23 21:28:34.735074] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:40.626 [2024-04-23 21:28:34.735083] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:27:40.626 [2024-04-23 21:28:34.735088] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735093] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735097] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735100] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735104] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735108] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735112] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735115] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735119] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735123] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735127] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735130] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735134] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735138] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735142] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735146] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735152] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735156] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735159] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735163] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735167] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735170] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735174] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735178] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735182] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735186] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735189] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735193] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735197] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735200] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735204] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735208] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:27:40.626 [2024-04-23 21:28:34.735211] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:40.626 [2024-04-23 21:28:34.735214] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:27:40.626 [2024-04-23 21:28:34.735226] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.735236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x184800 00:27:40.626 [2024-04-23 21:28:34.741283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.626 [2024-04-23 21:28:34.741290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.626 [2024-04-23 21:28:34.741295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.626 [2024-04-23 21:28:34.741300] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:40.626 [2024-04-23 21:28:34.741305] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:27:40.626 [2024-04-23 21:28:34.741309] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:27:40.626 [2024-04-23 21:28:34.741319] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741325] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741342] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741354] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:27:40.627 [2024-04-23 21:28:34.741360] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741364] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:27:40.627 [2024-04-23 21:28:34.741370] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741390] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741398] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:27:40.627 [2024-04-23 21:28:34.741401] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741406] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741411] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741416] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741435] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741443] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741446] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741452] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741457] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741472] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741480] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:27:40.627 [2024-04-23 21:28:34.741483] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741487] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741491] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741596] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:27:40.627 [2024-04-23 21:28:34.741599] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741605] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741610] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741629] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741638] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:40.627 [2024-04-23 21:28:34.741642] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741648] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741675] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741682] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:40.627 [2024-04-23 21:28:34.741686] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741689] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741694] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:27:40.627 [2024-04-23 21:28:34.741699] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741706] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x184800 00:27:40.627 [2024-04-23 21:28:34.741742] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741752] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:27:40.627 [2024-04-23 21:28:34.741755] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:27:40.627 [2024-04-23 21:28:34.741758] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:27:40.627 [2024-04-23 21:28:34.741764] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:27:40.627 [2024-04-23 21:28:34.741767] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:27:40.627 [2024-04-23 21:28:34.741771] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741774] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741779] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741784] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741789] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741804] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741815] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.627 [2024-04-23 21:28:34.741825] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.627 [2024-04-23 21:28:34.741834] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.627 [2024-04-23 21:28:34.741843] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.627 [2024-04-23 21:28:34.741851] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741854] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741861] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741866] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741872] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741888] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741896] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:27:40.627 [2024-04-23 21:28:34.741899] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741903] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741908] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741913] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741918] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.627 [2024-04-23 21:28:34.741923] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.627 [2024-04-23 21:28:34.741943] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.627 [2024-04-23 21:28:34.741947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:27:40.627 [2024-04-23 21:28:34.741984] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:27:40.627 [2024-04-23 21:28:34.741987] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.741993] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742001] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742006] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742028] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742040] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:27:40.628 [2024-04-23 21:28:34.742052] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742056] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742062] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742067] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742072] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742099] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742112] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742116] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742121] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742127] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742132] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742152] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742161] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742165] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742170] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742176] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742181] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742185] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742190] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:27:40.628 [2024-04-23 21:28:34.742195] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:27:40.628 [2024-04-23 21:28:34.742199] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:27:40.628 [2024-04-23 21:28:34.742209] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742215] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.628 [2024-04-23 21:28:34.742220] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:40.628 [2024-04-23 21:28:34.742235] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742243] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742249] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742254] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:0 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.628 [2024-04-23 21:28:34.742259] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742266] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742291] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742297] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742302] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:0 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.628 [2024-04-23 21:28:34.742318] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742325] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742331] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742336] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.628 [2024-04-23 21:28:34.742355] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742362] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742370] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742375] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742384] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742395] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742405] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x184800 00:27:40.628 [2024-04-23 21:28:34.742416] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742430] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742442] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742452] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742455] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742463] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.628 [2024-04-23 21:28:34.742470] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.628 [2024-04-23 21:28:34.742474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:27:40.628 [2024-04-23 21:28:34.742482] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.628 ===================================================== 00:27:40.628 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:27:40.628 ===================================================== 00:27:40.628 Controller Capabilities/Features 00:27:40.628 ================================ 00:27:40.628 Vendor ID: 8086 00:27:40.628 Subsystem Vendor ID: 8086 00:27:40.628 Serial Number: SPDK00000000000001 00:27:40.628 Model Number: SPDK bdev Controller 00:27:40.628 Firmware Version: 24.05 00:27:40.628 Recommended Arb Burst: 6 00:27:40.628 IEEE OUI Identifier: e4 d2 5c 00:27:40.628 Multi-path I/O 00:27:40.628 May have multiple subsystem ports: Yes 00:27:40.628 May have multiple controllers: Yes 00:27:40.628 Associated with SR-IOV VF: No 00:27:40.628 Max Data Transfer Size: 131072 00:27:40.628 Max Number of Namespaces: 32 00:27:40.628 Max Number of I/O Queues: 127 00:27:40.628 NVMe Specification Version (VS): 1.3 00:27:40.628 NVMe Specification Version (Identify): 1.3 00:27:40.628 Maximum Queue Entries: 128 00:27:40.628 Contiguous Queues Required: Yes 00:27:40.628 Arbitration Mechanisms Supported 00:27:40.629 Weighted Round Robin: Not Supported 00:27:40.629 Vendor Specific: Not Supported 00:27:40.629 Reset Timeout: 15000 ms 00:27:40.629 Doorbell Stride: 4 bytes 00:27:40.629 NVM Subsystem Reset: Not Supported 00:27:40.629 Command Sets Supported 00:27:40.629 NVM Command Set: Supported 00:27:40.629 Boot Partition: Not Supported 00:27:40.629 Memory Page Size Minimum: 4096 bytes 00:27:40.629 Memory Page Size Maximum: 4096 bytes 00:27:40.629 Persistent Memory Region: Not Supported 00:27:40.629 Optional Asynchronous Events Supported 00:27:40.629 Namespace Attribute Notices: Supported 00:27:40.629 Firmware Activation Notices: Not Supported 00:27:40.629 ANA Change Notices: Not Supported 00:27:40.629 PLE Aggregate Log Change Notices: Not Supported 00:27:40.629 LBA Status Info Alert Notices: Not Supported 00:27:40.629 EGE Aggregate Log Change Notices: Not Supported 00:27:40.629 Normal NVM Subsystem Shutdown event: Not Supported 00:27:40.629 Zone Descriptor Change Notices: Not Supported 00:27:40.629 Discovery Log Change Notices: Not Supported 00:27:40.629 Controller Attributes 00:27:40.629 128-bit Host Identifier: Supported 00:27:40.629 Non-Operational Permissive Mode: Not Supported 00:27:40.629 NVM Sets: Not Supported 00:27:40.629 Read Recovery Levels: Not Supported 00:27:40.629 Endurance Groups: Not Supported 00:27:40.629 Predictable Latency Mode: Not Supported 00:27:40.629 Traffic Based Keep ALive: Not Supported 00:27:40.629 Namespace Granularity: Not Supported 00:27:40.629 SQ Associations: Not Supported 00:27:40.629 UUID List: Not Supported 00:27:40.629 Multi-Domain Subsystem: Not Supported 00:27:40.629 Fixed Capacity Management: Not Supported 00:27:40.629 Variable Capacity Management: Not Supported 00:27:40.629 Delete Endurance Group: Not Supported 00:27:40.629 Delete NVM Set: Not Supported 00:27:40.629 Extended LBA Formats Supported: Not Supported 00:27:40.629 Flexible Data Placement Supported: Not Supported 00:27:40.629 00:27:40.629 Controller Memory Buffer Support 00:27:40.629 ================================ 00:27:40.629 Supported: No 00:27:40.629 00:27:40.629 Persistent Memory Region Support 00:27:40.629 ================================ 00:27:40.629 Supported: No 00:27:40.629 00:27:40.629 Admin Command Set Attributes 00:27:40.629 ============================ 00:27:40.629 Security Send/Receive: Not Supported 00:27:40.629 Format NVM: Not Supported 00:27:40.629 Firmware Activate/Download: Not Supported 00:27:40.629 Namespace Management: Not Supported 00:27:40.629 Device Self-Test: Not Supported 00:27:40.629 Directives: Not Supported 00:27:40.629 NVMe-MI: Not Supported 00:27:40.629 Virtualization Management: Not Supported 00:27:40.629 Doorbell Buffer Config: Not Supported 00:27:40.629 Get LBA Status Capability: Not Supported 00:27:40.629 Command & Feature Lockdown Capability: Not Supported 00:27:40.629 Abort Command Limit: 4 00:27:40.629 Async Event Request Limit: 4 00:27:40.629 Number of Firmware Slots: N/A 00:27:40.629 Firmware Slot 1 Read-Only: N/A 00:27:40.629 Firmware Activation Without Reset: N/A 00:27:40.629 Multiple Update Detection Support: N/A 00:27:40.629 Firmware Update Granularity: No Information Provided 00:27:40.629 Per-Namespace SMART Log: No 00:27:40.629 Asymmetric Namespace Access Log Page: Not Supported 00:27:40.629 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:27:40.629 Command Effects Log Page: Supported 00:27:40.629 Get Log Page Extended Data: Supported 00:27:40.629 Telemetry Log Pages: Not Supported 00:27:40.629 Persistent Event Log Pages: Not Supported 00:27:40.629 Supported Log Pages Log Page: May Support 00:27:40.629 Commands Supported & Effects Log Page: Not Supported 00:27:40.629 Feature Identifiers & Effects Log Page:May Support 00:27:40.629 NVMe-MI Commands & Effects Log Page: May Support 00:27:40.629 Data Area 4 for Telemetry Log: Not Supported 00:27:40.629 Error Log Page Entries Supported: 128 00:27:40.629 Keep Alive: Supported 00:27:40.629 Keep Alive Granularity: 10000 ms 00:27:40.629 00:27:40.629 NVM Command Set Attributes 00:27:40.629 ========================== 00:27:40.629 Submission Queue Entry Size 00:27:40.629 Max: 64 00:27:40.629 Min: 64 00:27:40.629 Completion Queue Entry Size 00:27:40.629 Max: 16 00:27:40.629 Min: 16 00:27:40.629 Number of Namespaces: 32 00:27:40.629 Compare Command: Supported 00:27:40.629 Write Uncorrectable Command: Not Supported 00:27:40.629 Dataset Management Command: Supported 00:27:40.629 Write Zeroes Command: Supported 00:27:40.629 Set Features Save Field: Not Supported 00:27:40.629 Reservations: Supported 00:27:40.629 Timestamp: Not Supported 00:27:40.629 Copy: Supported 00:27:40.629 Volatile Write Cache: Present 00:27:40.629 Atomic Write Unit (Normal): 1 00:27:40.629 Atomic Write Unit (PFail): 1 00:27:40.629 Atomic Compare & Write Unit: 1 00:27:40.629 Fused Compare & Write: Supported 00:27:40.629 Scatter-Gather List 00:27:40.629 SGL Command Set: Supported 00:27:40.629 SGL Keyed: Supported 00:27:40.629 SGL Bit Bucket Descriptor: Not Supported 00:27:40.629 SGL Metadata Pointer: Not Supported 00:27:40.629 Oversized SGL: Not Supported 00:27:40.629 SGL Metadata Address: Not Supported 00:27:40.629 SGL Offset: Supported 00:27:40.629 Transport SGL Data Block: Not Supported 00:27:40.629 Replay Protected Memory Block: Not Supported 00:27:40.629 00:27:40.629 Firmware Slot Information 00:27:40.629 ========================= 00:27:40.629 Active slot: 1 00:27:40.629 Slot 1 Firmware Revision: 24.05 00:27:40.629 00:27:40.629 00:27:40.629 Commands Supported and Effects 00:27:40.629 ============================== 00:27:40.629 Admin Commands 00:27:40.629 -------------- 00:27:40.629 Get Log Page (02h): Supported 00:27:40.629 Identify (06h): Supported 00:27:40.629 Abort (08h): Supported 00:27:40.629 Set Features (09h): Supported 00:27:40.629 Get Features (0Ah): Supported 00:27:40.629 Asynchronous Event Request (0Ch): Supported 00:27:40.629 Keep Alive (18h): Supported 00:27:40.629 I/O Commands 00:27:40.629 ------------ 00:27:40.629 Flush (00h): Supported LBA-Change 00:27:40.629 Write (01h): Supported LBA-Change 00:27:40.629 Read (02h): Supported 00:27:40.629 Compare (05h): Supported 00:27:40.629 Write Zeroes (08h): Supported LBA-Change 00:27:40.629 Dataset Management (09h): Supported LBA-Change 00:27:40.629 Copy (19h): Supported LBA-Change 00:27:40.629 Unknown (79h): Supported LBA-Change 00:27:40.629 Unknown (7Ah): Supported 00:27:40.629 00:27:40.629 Error Log 00:27:40.629 ========= 00:27:40.629 00:27:40.629 Arbitration 00:27:40.629 =========== 00:27:40.629 Arbitration Burst: 1 00:27:40.629 00:27:40.629 Power Management 00:27:40.629 ================ 00:27:40.629 Number of Power States: 1 00:27:40.629 Current Power State: Power State #0 00:27:40.629 Power State #0: 00:27:40.629 Max Power: 0.00 W 00:27:40.629 Non-Operational State: Operational 00:27:40.629 Entry Latency: Not Reported 00:27:40.629 Exit Latency: Not Reported 00:27:40.629 Relative Read Throughput: 0 00:27:40.629 Relative Read Latency: 0 00:27:40.629 Relative Write Throughput: 0 00:27:40.629 Relative Write Latency: 0 00:27:40.629 Idle Power: Not Reported 00:27:40.629 Active Power: Not Reported 00:27:40.629 Non-Operational Permissive Mode: Not Supported 00:27:40.629 00:27:40.629 Health Information 00:27:40.629 ================== 00:27:40.629 Critical Warnings: 00:27:40.629 Available Spare Space: OK 00:27:40.629 Temperature: OK 00:27:40.629 Device Reliability: OK 00:27:40.629 Read Only: No 00:27:40.629 Volatile Memory Backup: OK 00:27:40.629 Current Temperature: 0 Kelvin (-273 Celsius) 00:27:40.629 Temperature Threshold: [2024-04-23 21:28:34.742558] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x184800 00:27:40.629 [2024-04-23 21:28:34.742564] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.629 [2024-04-23 21:28:34.742585] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.629 [2024-04-23 21:28:34.742589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:27:40.629 [2024-04-23 21:28:34.742593] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.629 [2024-04-23 21:28:34.742613] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:27:40.629 [2024-04-23 21:28:34.742619] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 57059 doesn't match qid 00:27:40.629 [2024-04-23 21:28:34.742632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32522 cdw0:5 sqhd:6790 p:0 m:0 dnr:0 00:27:40.629 [2024-04-23 21:28:34.742636] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 57059 doesn't match qid 00:27:40.629 [2024-04-23 21:28:34.742643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32522 cdw0:5 sqhd:6790 p:0 m:0 dnr:0 00:27:40.629 [2024-04-23 21:28:34.742647] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 57059 doesn't match qid 00:27:40.629 [2024-04-23 21:28:34.742653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32522 cdw0:5 sqhd:6790 p:0 m:0 dnr:0 00:27:40.629 [2024-04-23 21:28:34.742657] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 57059 doesn't match qid 00:27:40.630 [2024-04-23 21:28:34.742662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32522 cdw0:5 sqhd:6790 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742669] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742674] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742692] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742702] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742711] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742726] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742734] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:27:40.630 [2024-04-23 21:28:34.742737] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:27:40.630 [2024-04-23 21:28:34.742741] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742747] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742752] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742773] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742781] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742788] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742794] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742814] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742822] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742828] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742854] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742865] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742872] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742896] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742904] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742911] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742933] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742941] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742948] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742953] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.742969] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.742973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.742977] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742984] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.742989] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743017] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743023] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743043] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743051] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743057] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743079] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743087] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743093] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743098] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743114] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743122] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743128] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743133] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743146] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743154] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743160] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.630 [2024-04-23 21:28:34.743165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.630 [2024-04-23 21:28:34.743182] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.630 [2024-04-23 21:28:34.743186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:40.630 [2024-04-23 21:28:34.743190] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743196] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743217] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743225] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743231] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743249] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743257] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743263] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743268] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743293] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743301] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743307] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743312] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743327] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743335] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743341] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743346] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743366] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743374] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743380] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743402] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743410] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743416] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743421] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743437] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743445] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743450] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743473] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743480] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743486] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743506] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743514] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743520] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743538] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743546] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743552] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743557] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743578] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743586] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743592] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743597] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743610] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743617] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743624] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743629] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743649] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743656] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743662] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743667] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743685] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743698] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743705] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743725] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743733] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743738] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743743] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743757] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743764] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743770] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743776] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743797] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743805] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743811] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743816] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.631 [2024-04-23 21:28:34.743832] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.631 [2024-04-23 21:28:34.743835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:40.631 [2024-04-23 21:28:34.743839] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.631 [2024-04-23 21:28:34.743845] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743850] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.743865] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.743869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.743873] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743879] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743884] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.743903] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.743906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.743910] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743917] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743923] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.743940] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.743944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.743947] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743954] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743958] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.743976] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.743980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.743983] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743989] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.743994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744017] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744023] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744045] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744052] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744058] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744084] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744091] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744097] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744102] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744115] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744123] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744130] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744135] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744153] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744160] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744166] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744171] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744192] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744199] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744205] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744231] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744239] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744245] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744250] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744265] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744272] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744283] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744288] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744309] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744316] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744322] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744327] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744342] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744351] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744357] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744362] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744377] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744384] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744390] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744395] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744416] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744423] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744429] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744434] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744449] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744456] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744462] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744485] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.632 [2024-04-23 21:28:34.744489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:40.632 [2024-04-23 21:28:34.744492] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744499] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.632 [2024-04-23 21:28:34.744504] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.632 [2024-04-23 21:28:34.744524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744531] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744537] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744542] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744561] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744570] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744576] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744581] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744600] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744608] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744614] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744619] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744635] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744642] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744648] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744675] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744682] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744688] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744693] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744711] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744718] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744724] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744729] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744747] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744754] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744760] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744781] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744790] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744796] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744801] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744822] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744829] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744835] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744859] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744866] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744872] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744878] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744899] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744907] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744913] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744945] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744951] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744956] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.744974] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.744978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.744981] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744987] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.744992] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745010] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.745019] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745025] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745046] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.745053] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745059] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745064] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745084] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.745092] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745098] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745103] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745118] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.745125] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745131] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745136] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745154] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:40.633 [2024-04-23 21:28:34.745161] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745167] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.633 [2024-04-23 21:28:34.745172] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.633 [2024-04-23 21:28:34.745192] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.633 [2024-04-23 21:28:34.745196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:40.634 [2024-04-23 21:28:34.745200] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.745206] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.745211] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.634 [2024-04-23 21:28:34.745231] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.634 [2024-04-23 21:28:34.745235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:40.634 [2024-04-23 21:28:34.745238] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.745244] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.745249] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.634 [2024-04-23 21:28:34.745267] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.634 [2024-04-23 21:28:34.745271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:40.634 [2024-04-23 21:28:34.745274] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.749288] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.749294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:40.634 [2024-04-23 21:28:34.749309] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:40.634 [2024-04-23 21:28:34.749313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0000 p:0 m:0 dnr:0 00:27:40.634 [2024-04-23 21:28:34.749317] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x184800 00:27:40.634 [2024-04-23 21:28:34.749321] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:27:40.634 0 Kelvin (-273 Celsius) 00:27:40.634 Available Spare: 0% 00:27:40.634 Available Spare Threshold: 0% 00:27:40.634 Life Percentage Used: 0% 00:27:40.634 Data Units Read: 0 00:27:40.634 Data Units Written: 0 00:27:40.634 Host Read Commands: 0 00:27:40.634 Host Write Commands: 0 00:27:40.634 Controller Busy Time: 0 minutes 00:27:40.634 Power Cycles: 0 00:27:40.634 Power On Hours: 0 hours 00:27:40.634 Unsafe Shutdowns: 0 00:27:40.634 Unrecoverable Media Errors: 0 00:27:40.634 Lifetime Error Log Entries: 0 00:27:40.634 Warning Temperature Time: 0 minutes 00:27:40.634 Critical Temperature Time: 0 minutes 00:27:40.634 00:27:40.634 Number of Queues 00:27:40.634 ================ 00:27:40.634 Number of I/O Submission Queues: 127 00:27:40.634 Number of I/O Completion Queues: 127 00:27:40.634 00:27:40.634 Active Namespaces 00:27:40.634 ================= 00:27:40.634 Namespace ID:1 00:27:40.634 Error Recovery Timeout: Unlimited 00:27:40.634 Command Set Identifier: NVM (00h) 00:27:40.634 Deallocate: Supported 00:27:40.634 Deallocated/Unwritten Error: Not Supported 00:27:40.634 Deallocated Read Value: Unknown 00:27:40.634 Deallocate in Write Zeroes: Not Supported 00:27:40.634 Deallocated Guard Field: 0xFFFF 00:27:40.634 Flush: Supported 00:27:40.634 Reservation: Supported 00:27:40.634 Namespace Sharing Capabilities: Multiple Controllers 00:27:40.634 Size (in LBAs): 131072 (0GiB) 00:27:40.634 Capacity (in LBAs): 131072 (0GiB) 00:27:40.634 Utilization (in LBAs): 131072 (0GiB) 00:27:40.634 NGUID: ABCDEF0123456789ABCDEF0123456789 00:27:40.634 EUI64: ABCDEF0123456789 00:27:40.634 UUID: 8b78957a-47e4-4569-9e82-e7f14feb9341 00:27:40.634 Thin Provisioning: Not Supported 00:27:40.634 Per-NS Atomic Units: Yes 00:27:40.634 Atomic Boundary Size (Normal): 0 00:27:40.634 Atomic Boundary Size (PFail): 0 00:27:40.634 Atomic Boundary Offset: 0 00:27:40.634 Maximum Single Source Range Length: 65535 00:27:40.634 Maximum Copy Length: 65535 00:27:40.634 Maximum Source Range Count: 1 00:27:40.634 NGUID/EUI64 Never Reused: No 00:27:40.634 Namespace Write Protected: No 00:27:40.634 Number of LBA Formats: 1 00:27:40.634 Current LBA Format: LBA Format #00 00:27:40.634 LBA Format #00: Data Size: 512 Metadata Size: 0 00:27:40.634 00:27:40.634 21:28:34 -- host/identify.sh@51 -- # sync 00:27:40.634 21:28:34 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:40.634 21:28:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:40.634 21:28:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.634 21:28:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:40.634 21:28:34 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:27:40.634 21:28:34 -- host/identify.sh@56 -- # nvmftestfini 00:27:40.634 21:28:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:40.634 21:28:34 -- nvmf/common.sh@117 -- # sync 00:27:40.634 21:28:34 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:40.634 21:28:34 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:40.634 21:28:34 -- nvmf/common.sh@120 -- # set +e 00:27:40.634 21:28:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:40.634 21:28:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:40.634 rmmod nvme_rdma 00:27:40.634 rmmod nvme_fabrics 00:27:40.634 21:28:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:40.634 21:28:34 -- nvmf/common.sh@124 -- # set -e 00:27:40.634 21:28:34 -- nvmf/common.sh@125 -- # return 0 00:27:40.634 21:28:34 -- nvmf/common.sh@478 -- # '[' -n 1488834 ']' 00:27:40.634 21:28:34 -- nvmf/common.sh@479 -- # killprocess 1488834 00:27:40.634 21:28:34 -- common/autotest_common.sh@936 -- # '[' -z 1488834 ']' 00:27:40.634 21:28:34 -- common/autotest_common.sh@940 -- # kill -0 1488834 00:27:40.634 21:28:34 -- common/autotest_common.sh@941 -- # uname 00:27:40.634 21:28:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:40.634 21:28:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1488834 00:27:40.634 21:28:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:40.634 21:28:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:40.894 21:28:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1488834' 00:27:40.894 killing process with pid 1488834 00:27:40.894 21:28:34 -- common/autotest_common.sh@955 -- # kill 1488834 00:27:40.894 [2024-04-23 21:28:34.891983] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:40.894 21:28:34 -- common/autotest_common.sh@960 -- # wait 1488834 00:27:40.894 [2024-04-23 21:28:34.965543] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:41.154 21:28:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:41.154 21:28:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:41.154 00:27:41.154 real 0m7.168s 00:27:41.154 user 0m7.615s 00:27:41.154 sys 0m4.397s 00:27:41.154 21:28:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:41.154 21:28:35 -- common/autotest_common.sh@10 -- # set +x 00:27:41.154 ************************************ 00:27:41.154 END TEST nvmf_identify 00:27:41.154 ************************************ 00:27:41.154 21:28:35 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:27:41.154 21:28:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:41.154 21:28:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.154 21:28:35 -- common/autotest_common.sh@10 -- # set +x 00:27:41.154 ************************************ 00:27:41.154 START TEST nvmf_perf 00:27:41.154 ************************************ 00:27:41.154 21:28:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:27:41.154 * Looking for test storage... 00:27:41.154 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:41.154 21:28:35 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:41.154 21:28:35 -- nvmf/common.sh@7 -- # uname -s 00:27:41.154 21:28:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:41.154 21:28:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:41.154 21:28:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:41.154 21:28:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:41.154 21:28:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:41.154 21:28:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:41.154 21:28:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:41.154 21:28:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:41.154 21:28:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:41.154 21:28:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:41.154 21:28:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:41.154 21:28:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:41.154 21:28:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:41.154 21:28:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:41.154 21:28:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:41.413 21:28:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:41.413 21:28:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:41.413 21:28:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:41.413 21:28:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:41.413 21:28:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:41.414 21:28:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.414 21:28:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.414 21:28:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.414 21:28:35 -- paths/export.sh@5 -- # export PATH 00:27:41.414 21:28:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.414 21:28:35 -- nvmf/common.sh@47 -- # : 0 00:27:41.414 21:28:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:41.414 21:28:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:41.414 21:28:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:41.414 21:28:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:41.414 21:28:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:41.414 21:28:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:41.414 21:28:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:41.414 21:28:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:41.414 21:28:35 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:27:41.414 21:28:35 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:27:41.414 21:28:35 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:27:41.414 21:28:35 -- host/perf.sh@17 -- # nvmftestinit 00:27:41.414 21:28:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:41.414 21:28:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:41.414 21:28:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:41.414 21:28:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:41.414 21:28:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:41.414 21:28:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:41.414 21:28:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:41.414 21:28:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:41.414 21:28:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:41.414 21:28:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:41.414 21:28:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:41.414 21:28:35 -- common/autotest_common.sh@10 -- # set +x 00:27:46.690 21:28:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:46.690 21:28:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:46.690 21:28:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:46.691 21:28:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:46.691 21:28:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:46.691 21:28:40 -- nvmf/common.sh@295 -- # net_devs=() 00:27:46.691 21:28:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@296 -- # e810=() 00:27:46.691 21:28:40 -- nvmf/common.sh@296 -- # local -ga e810 00:27:46.691 21:28:40 -- nvmf/common.sh@297 -- # x722=() 00:27:46.691 21:28:40 -- nvmf/common.sh@297 -- # local -ga x722 00:27:46.691 21:28:40 -- nvmf/common.sh@298 -- # mlx=() 00:27:46.691 21:28:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:46.691 21:28:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:46.691 21:28:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:46.691 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:46.691 21:28:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:46.691 21:28:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:46.691 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:46.691 21:28:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:46.691 21:28:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:46.691 21:28:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:46.691 21:28:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:46.691 Found net devices under 0000:18:00.0: mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:46.691 21:28:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:46.691 21:28:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:46.691 Found net devices under 0000:18:00.1: mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:46.691 21:28:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:46.691 21:28:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:46.691 21:28:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:46.691 21:28:40 -- nvmf/common.sh@58 -- # uname 00:27:46.691 21:28:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:46.691 21:28:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:46.691 21:28:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:46.691 21:28:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:46.691 21:28:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:46.691 21:28:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:46.691 21:28:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:46.691 21:28:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:46.691 21:28:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:46.691 21:28:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:46.691 21:28:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:46.691 21:28:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:46.691 21:28:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:46.691 21:28:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@105 -- # continue 2 00:27:46.691 21:28:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@105 -- # continue 2 00:27:46.691 21:28:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:46.691 21:28:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:46.691 21:28:40 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:46.691 21:28:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:46.691 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:46.691 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:46.691 altname enp24s0f0np0 00:27:46.691 altname ens785f0np0 00:27:46.691 inet 192.168.100.8/24 scope global mlx_0_0 00:27:46.691 valid_lft forever preferred_lft forever 00:27:46.691 21:28:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:46.691 21:28:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:46.691 21:28:40 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:46.691 21:28:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:46.691 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:46.691 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:46.691 altname enp24s0f1np1 00:27:46.691 altname ens785f1np1 00:27:46.691 inet 192.168.100.9/24 scope global mlx_0_1 00:27:46.691 valid_lft forever preferred_lft forever 00:27:46.691 21:28:40 -- nvmf/common.sh@411 -- # return 0 00:27:46.691 21:28:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:46.691 21:28:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:46.691 21:28:40 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:46.691 21:28:40 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:46.691 21:28:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:46.691 21:28:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:46.691 21:28:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:46.691 21:28:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:46.691 21:28:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@105 -- # continue 2 00:27:46.691 21:28:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:46.691 21:28:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:46.691 21:28:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:46.691 21:28:40 -- nvmf/common.sh@105 -- # continue 2 00:27:46.691 21:28:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:46.691 21:28:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:46.691 21:28:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:46.692 21:28:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:46.692 21:28:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:46.692 21:28:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:46.692 21:28:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:46.692 21:28:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:46.692 21:28:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:46.692 21:28:40 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:46.692 192.168.100.9' 00:27:46.692 21:28:40 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:46.692 192.168.100.9' 00:27:46.692 21:28:40 -- nvmf/common.sh@446 -- # head -n 1 00:27:46.692 21:28:40 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:46.692 21:28:40 -- nvmf/common.sh@447 -- # head -n 1 00:27:46.692 21:28:40 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:46.692 192.168.100.9' 00:27:46.692 21:28:40 -- nvmf/common.sh@447 -- # tail -n +2 00:27:46.692 21:28:40 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:46.692 21:28:40 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:46.692 21:28:40 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:46.692 21:28:40 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:46.692 21:28:40 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:46.692 21:28:40 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:46.692 21:28:40 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:27:46.692 21:28:40 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:46.692 21:28:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:46.692 21:28:40 -- common/autotest_common.sh@10 -- # set +x 00:27:46.692 21:28:40 -- nvmf/common.sh@470 -- # nvmfpid=1492480 00:27:46.692 21:28:40 -- nvmf/common.sh@471 -- # waitforlisten 1492480 00:27:46.692 21:28:40 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:46.692 21:28:40 -- common/autotest_common.sh@817 -- # '[' -z 1492480 ']' 00:27:46.692 21:28:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:46.692 21:28:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:46.692 21:28:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:46.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:46.692 21:28:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:46.692 21:28:40 -- common/autotest_common.sh@10 -- # set +x 00:27:46.951 [2024-04-23 21:28:40.972572] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:27:46.951 [2024-04-23 21:28:40.972613] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:46.951 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.951 [2024-04-23 21:28:41.020826] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:46.951 [2024-04-23 21:28:41.088520] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:46.951 [2024-04-23 21:28:41.088562] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:46.951 [2024-04-23 21:28:41.088568] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:46.951 [2024-04-23 21:28:41.088574] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:46.951 [2024-04-23 21:28:41.088578] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:46.951 [2024-04-23 21:28:41.088615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:46.951 [2024-04-23 21:28:41.088707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:46.951 [2024-04-23 21:28:41.088781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:46.951 [2024-04-23 21:28:41.088782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:47.518 21:28:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:47.518 21:28:41 -- common/autotest_common.sh@850 -- # return 0 00:27:47.518 21:28:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:47.518 21:28:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:47.518 21:28:41 -- common/autotest_common.sh@10 -- # set +x 00:27:47.776 21:28:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:47.776 21:28:41 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:47.777 21:28:41 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:27:51.064 21:28:44 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:27:51.064 21:28:44 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:27:51.064 21:28:44 -- host/perf.sh@30 -- # local_nvme_trid=0000:d8:00.0 00:27:51.064 21:28:44 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:27:51.064 21:28:45 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:27:51.064 21:28:45 -- host/perf.sh@33 -- # '[' -n 0000:d8:00.0 ']' 00:27:51.064 21:28:45 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:27:51.064 21:28:45 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:27:51.064 21:28:45 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:27:51.064 [2024-04-23 21:28:45.307604] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:27:51.064 [2024-04-23 21:28:45.326755] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x118db80/0x119b680) succeed. 00:27:51.323 [2024-04-23 21:28:45.336124] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x118f1c0/0x123b780) succeed. 00:27:51.323 21:28:45 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:51.582 21:28:45 -- host/perf.sh@45 -- # for bdev in $bdevs 00:27:51.582 21:28:45 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:51.582 21:28:45 -- host/perf.sh@45 -- # for bdev in $bdevs 00:27:51.582 21:28:45 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:27:51.841 21:28:45 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:51.841 [2024-04-23 21:28:46.084496] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:51.841 21:28:46 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:27:52.099 21:28:46 -- host/perf.sh@52 -- # '[' -n 0000:d8:00.0 ']' 00:27:52.099 21:28:46 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:d8:00.0' 00:27:52.099 21:28:46 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:27:52.099 21:28:46 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:d8:00.0' 00:27:53.475 Initializing NVMe Controllers 00:27:53.475 Attached to NVMe Controller at 0000:d8:00.0 [8086:0a54] 00:27:53.475 Associating PCIE (0000:d8:00.0) NSID 1 with lcore 0 00:27:53.475 Initialization complete. Launching workers. 00:27:53.475 ======================================================== 00:27:53.475 Latency(us) 00:27:53.475 Device Information : IOPS MiB/s Average min max 00:27:53.475 PCIE (0000:d8:00.0) NSID 1 from core 0: 106372.20 415.52 300.40 37.37 5185.03 00:27:53.475 ======================================================== 00:27:53.475 Total : 106372.20 415.52 300.40 37.37 5185.03 00:27:53.475 00:27:53.475 21:28:47 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:27:53.475 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.765 Initializing NVMe Controllers 00:27:56.765 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:27:56.765 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:56.765 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:27:56.765 Initialization complete. Launching workers. 00:27:56.765 ======================================================== 00:27:56.765 Latency(us) 00:27:56.765 Device Information : IOPS MiB/s Average min max 00:27:56.765 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7273.76 28.41 137.29 43.58 4074.87 00:27:56.765 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5582.86 21.81 178.93 66.26 4102.88 00:27:56.765 ======================================================== 00:27:56.765 Total : 12856.63 50.22 155.37 43.58 4102.88 00:27:56.765 00:27:56.765 21:28:50 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:27:56.765 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.125 Initializing NVMe Controllers 00:28:00.125 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:00.125 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:00.125 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:00.125 Initialization complete. Launching workers. 00:28:00.125 ======================================================== 00:28:00.125 Latency(us) 00:28:00.125 Device Information : IOPS MiB/s Average min max 00:28:00.125 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19853.25 77.55 1612.17 452.83 5384.89 00:28:00.125 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4031.85 15.75 7971.66 6811.30 9160.08 00:28:00.125 ======================================================== 00:28:00.125 Total : 23885.09 93.30 2685.66 452.83 9160.08 00:28:00.125 00:28:00.125 21:28:54 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:28:00.125 21:28:54 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:00.125 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.318 Initializing NVMe Controllers 00:28:04.318 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:04.318 Controller IO queue size 128, less than required. 00:28:04.318 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:04.318 Controller IO queue size 128, less than required. 00:28:04.318 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:04.318 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:04.318 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:04.318 Initialization complete. Launching workers. 00:28:04.318 ======================================================== 00:28:04.318 Latency(us) 00:28:04.318 Device Information : IOPS MiB/s Average min max 00:28:04.318 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3753.50 938.38 34264.17 15424.64 80098.88 00:28:04.318 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3829.00 957.25 33131.52 15378.46 54903.98 00:28:04.318 ======================================================== 00:28:04.318 Total : 7582.50 1895.62 33692.20 15378.46 80098.88 00:28:04.318 00:28:04.318 21:28:58 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:28:04.318 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.577 No valid NVMe controllers or AIO or URING devices found 00:28:04.836 Initializing NVMe Controllers 00:28:04.836 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:04.836 Controller IO queue size 128, less than required. 00:28:04.836 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:04.836 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:28:04.836 Controller IO queue size 128, less than required. 00:28:04.836 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:04.836 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:28:04.836 WARNING: Some requested NVMe devices were skipped 00:28:04.836 21:28:58 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:28:04.836 EAL: No free 2048 kB hugepages reported on node 1 00:28:09.029 Initializing NVMe Controllers 00:28:09.029 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:09.029 Controller IO queue size 128, less than required. 00:28:09.029 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:09.029 Controller IO queue size 128, less than required. 00:28:09.029 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:09.029 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:09.029 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:09.029 Initialization complete. Launching workers. 00:28:09.029 00:28:09.029 ==================== 00:28:09.029 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:28:09.029 RDMA transport: 00:28:09.029 dev name: mlx5_0 00:28:09.029 polls: 432797 00:28:09.029 idle_polls: 428672 00:28:09.029 completions: 47758 00:28:09.029 queued_requests: 1 00:28:09.029 total_send_wrs: 23879 00:28:09.029 send_doorbell_updates: 3891 00:28:09.029 total_recv_wrs: 24006 00:28:09.029 recv_doorbell_updates: 3893 00:28:09.029 --------------------------------- 00:28:09.029 00:28:09.029 ==================== 00:28:09.029 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:28:09.029 RDMA transport: 00:28:09.029 dev name: mlx5_0 00:28:09.029 polls: 440145 00:28:09.029 idle_polls: 439872 00:28:09.029 completions: 21166 00:28:09.029 queued_requests: 1 00:28:09.029 total_send_wrs: 10583 00:28:09.029 send_doorbell_updates: 252 00:28:09.029 total_recv_wrs: 10710 00:28:09.029 recv_doorbell_updates: 254 00:28:09.029 --------------------------------- 00:28:09.029 ======================================================== 00:28:09.029 Latency(us) 00:28:09.029 Device Information : IOPS MiB/s Average min max 00:28:09.029 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5969.50 1492.38 21459.26 10624.74 58531.67 00:28:09.029 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2645.50 661.38 48255.91 29342.32 71624.38 00:28:09.029 ======================================================== 00:28:09.029 Total : 8615.00 2153.75 29688.00 10624.74 71624.38 00:28:09.029 00:28:09.029 21:29:03 -- host/perf.sh@66 -- # sync 00:28:09.029 21:29:03 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:09.286 21:29:03 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:28:09.286 21:29:03 -- host/perf.sh@71 -- # '[' -n 0000:d8:00.0 ']' 00:28:09.286 21:29:03 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:28:24.168 21:29:15 -- host/perf.sh@72 -- # ls_guid=69476b40-e008-4a27-87a3-2eb79fe7f945 00:28:24.168 21:29:15 -- host/perf.sh@73 -- # get_lvs_free_mb 69476b40-e008-4a27-87a3-2eb79fe7f945 00:28:24.168 21:29:15 -- common/autotest_common.sh@1350 -- # local lvs_uuid=69476b40-e008-4a27-87a3-2eb79fe7f945 00:28:24.168 21:29:15 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:24.168 21:29:15 -- common/autotest_common.sh@1352 -- # local fc 00:28:24.168 21:29:15 -- common/autotest_common.sh@1353 -- # local cs 00:28:24.168 21:29:15 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:24.168 21:29:16 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:24.168 { 00:28:24.168 "uuid": "69476b40-e008-4a27-87a3-2eb79fe7f945", 00:28:24.168 "name": "lvs_0", 00:28:24.168 "base_bdev": "Nvme0n1", 00:28:24.168 "total_data_clusters": 952929, 00:28:24.168 "free_clusters": 952929, 00:28:24.168 "block_size": 512, 00:28:24.168 "cluster_size": 4194304 00:28:24.168 } 00:28:24.168 ]' 00:28:24.168 21:29:16 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="69476b40-e008-4a27-87a3-2eb79fe7f945") .free_clusters' 00:28:24.168 21:29:16 -- common/autotest_common.sh@1355 -- # fc=952929 00:28:24.168 21:29:16 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="69476b40-e008-4a27-87a3-2eb79fe7f945") .cluster_size' 00:28:24.168 21:29:16 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:24.168 21:29:16 -- common/autotest_common.sh@1359 -- # free_mb=3811716 00:28:24.168 21:29:16 -- common/autotest_common.sh@1360 -- # echo 3811716 00:28:24.168 3811716 00:28:24.168 21:29:16 -- host/perf.sh@77 -- # '[' 3811716 -gt 20480 ']' 00:28:24.168 21:29:16 -- host/perf.sh@78 -- # free_mb=20480 00:28:24.168 21:29:16 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 69476b40-e008-4a27-87a3-2eb79fe7f945 lbd_0 20480 00:28:24.168 21:29:17 -- host/perf.sh@80 -- # lb_guid=7377d6ec-d47d-49e8-b37e-cdeaa24ec482 00:28:24.168 21:29:17 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 7377d6ec-d47d-49e8-b37e-cdeaa24ec482 lvs_n_0 00:28:24.427 21:29:18 -- host/perf.sh@83 -- # ls_nested_guid=983d6e21-950b-4930-bc6f-988ce43fc293 00:28:24.427 21:29:18 -- host/perf.sh@84 -- # get_lvs_free_mb 983d6e21-950b-4930-bc6f-988ce43fc293 00:28:24.427 21:29:18 -- common/autotest_common.sh@1350 -- # local lvs_uuid=983d6e21-950b-4930-bc6f-988ce43fc293 00:28:24.428 21:29:18 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:24.428 21:29:18 -- common/autotest_common.sh@1352 -- # local fc 00:28:24.428 21:29:18 -- common/autotest_common.sh@1353 -- # local cs 00:28:24.428 21:29:18 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:24.686 21:29:18 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:24.686 { 00:28:24.686 "uuid": "69476b40-e008-4a27-87a3-2eb79fe7f945", 00:28:24.686 "name": "lvs_0", 00:28:24.686 "base_bdev": "Nvme0n1", 00:28:24.686 "total_data_clusters": 952929, 00:28:24.686 "free_clusters": 947809, 00:28:24.686 "block_size": 512, 00:28:24.686 "cluster_size": 4194304 00:28:24.686 }, 00:28:24.687 { 00:28:24.687 "uuid": "983d6e21-950b-4930-bc6f-988ce43fc293", 00:28:24.687 "name": "lvs_n_0", 00:28:24.687 "base_bdev": "7377d6ec-d47d-49e8-b37e-cdeaa24ec482", 00:28:24.687 "total_data_clusters": 5114, 00:28:24.687 "free_clusters": 5114, 00:28:24.687 "block_size": 512, 00:28:24.687 "cluster_size": 4194304 00:28:24.687 } 00:28:24.687 ]' 00:28:24.687 21:29:18 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="983d6e21-950b-4930-bc6f-988ce43fc293") .free_clusters' 00:28:24.687 21:29:18 -- common/autotest_common.sh@1355 -- # fc=5114 00:28:24.687 21:29:18 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="983d6e21-950b-4930-bc6f-988ce43fc293") .cluster_size' 00:28:24.687 21:29:18 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:24.687 21:29:18 -- common/autotest_common.sh@1359 -- # free_mb=20456 00:28:24.687 21:29:18 -- common/autotest_common.sh@1360 -- # echo 20456 00:28:24.687 20456 00:28:24.687 21:29:18 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:28:24.687 21:29:18 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 983d6e21-950b-4930-bc6f-988ce43fc293 lbd_nest_0 20456 00:28:24.945 21:29:19 -- host/perf.sh@88 -- # lb_nested_guid=d601e1c2-1fc9-41ea-b648-345f3adba601 00:28:24.946 21:29:19 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:25.205 21:29:19 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:28:25.205 21:29:19 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 d601e1c2-1fc9-41ea-b648-345f3adba601 00:28:25.205 21:29:19 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:25.464 21:29:19 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:28:25.464 21:29:19 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:28:25.464 21:29:19 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:25.464 21:29:19 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:25.464 21:29:19 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:25.464 EAL: No free 2048 kB hugepages reported on node 1 00:28:37.669 Initializing NVMe Controllers 00:28:37.669 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:37.669 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:37.669 Initialization complete. Launching workers. 00:28:37.669 ======================================================== 00:28:37.669 Latency(us) 00:28:37.669 Device Information : IOPS MiB/s Average min max 00:28:37.669 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6201.33 3.03 161.00 63.95 8033.58 00:28:37.669 ======================================================== 00:28:37.669 Total : 6201.33 3.03 161.00 63.95 8033.58 00:28:37.669 00:28:37.669 21:29:30 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:37.669 21:29:30 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:37.669 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.879 Initializing NVMe Controllers 00:28:49.879 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:49.879 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:49.879 Initialization complete. Launching workers. 00:28:49.879 ======================================================== 00:28:49.879 Latency(us) 00:28:49.879 Device Information : IOPS MiB/s Average min max 00:28:49.879 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2698.66 337.33 370.07 152.70 8044.50 00:28:49.879 ======================================================== 00:28:49.879 Total : 2698.66 337.33 370.07 152.70 8044.50 00:28:49.879 00:28:49.879 21:29:42 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:49.879 21:29:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:49.879 21:29:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:49.879 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.857 Initializing NVMe Controllers 00:28:59.857 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:59.857 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:59.857 Initialization complete. Launching workers. 00:28:59.857 ======================================================== 00:28:59.857 Latency(us) 00:28:59.857 Device Information : IOPS MiB/s Average min max 00:28:59.857 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12334.28 6.02 2594.41 870.63 8438.85 00:28:59.857 ======================================================== 00:28:59.857 Total : 12334.28 6.02 2594.41 870.63 8438.85 00:28:59.857 00:28:59.857 21:29:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:59.857 21:29:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:59.857 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.127 Initializing NVMe Controllers 00:29:12.127 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:12.127 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:12.127 Initialization complete. Launching workers. 00:29:12.127 ======================================================== 00:29:12.127 Latency(us) 00:29:12.127 Device Information : IOPS MiB/s Average min max 00:29:12.127 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3998.90 499.86 8008.04 4911.41 16005.34 00:29:12.127 ======================================================== 00:29:12.127 Total : 3998.90 499.86 8008.04 4911.41 16005.34 00:29:12.127 00:29:12.127 21:30:04 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:29:12.127 21:30:04 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:12.127 21:30:04 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:12.127 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.105 Initializing NVMe Controllers 00:29:22.105 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:22.105 Controller IO queue size 128, less than required. 00:29:22.105 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:22.105 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:22.105 Initialization complete. Launching workers. 00:29:22.105 ======================================================== 00:29:22.105 Latency(us) 00:29:22.105 Device Information : IOPS MiB/s Average min max 00:29:22.105 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19819.70 9.68 6460.80 1583.09 15744.49 00:29:22.105 ======================================================== 00:29:22.105 Total : 19819.70 9.68 6460.80 1583.09 15744.49 00:29:22.105 00:29:22.105 21:30:16 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:22.105 21:30:16 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:22.105 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.316 Initializing NVMe Controllers 00:29:34.316 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:34.316 Controller IO queue size 128, less than required. 00:29:34.316 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:34.316 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:34.316 Initialization complete. Launching workers. 00:29:34.316 ======================================================== 00:29:34.316 Latency(us) 00:29:34.316 Device Information : IOPS MiB/s Average min max 00:29:34.316 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11426.80 1428.35 11204.79 3253.68 23840.01 00:29:34.316 ======================================================== 00:29:34.316 Total : 11426.80 1428.35 11204.79 3253.68 23840.01 00:29:34.316 00:29:34.316 21:30:27 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:34.316 21:30:27 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d601e1c2-1fc9-41ea-b648-345f3adba601 00:29:34.316 21:30:28 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:29:34.316 21:30:28 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7377d6ec-d47d-49e8-b37e-cdeaa24ec482 00:29:34.575 21:30:28 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:29:34.834 21:30:28 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:29:34.834 21:30:28 -- host/perf.sh@114 -- # nvmftestfini 00:29:34.834 21:30:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:34.834 21:30:28 -- nvmf/common.sh@117 -- # sync 00:29:34.834 21:30:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:29:34.834 21:30:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:29:34.834 21:30:28 -- nvmf/common.sh@120 -- # set +e 00:29:34.834 21:30:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:34.834 21:30:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:29:34.834 rmmod nvme_rdma 00:29:34.834 rmmod nvme_fabrics 00:29:34.834 21:30:29 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:34.834 21:30:29 -- nvmf/common.sh@124 -- # set -e 00:29:34.834 21:30:29 -- nvmf/common.sh@125 -- # return 0 00:29:34.834 21:30:29 -- nvmf/common.sh@478 -- # '[' -n 1492480 ']' 00:29:34.834 21:30:29 -- nvmf/common.sh@479 -- # killprocess 1492480 00:29:34.834 21:30:29 -- common/autotest_common.sh@936 -- # '[' -z 1492480 ']' 00:29:34.834 21:30:29 -- common/autotest_common.sh@940 -- # kill -0 1492480 00:29:34.834 21:30:29 -- common/autotest_common.sh@941 -- # uname 00:29:34.834 21:30:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:34.834 21:30:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1492480 00:29:34.834 21:30:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:34.834 21:30:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:34.834 21:30:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1492480' 00:29:34.834 killing process with pid 1492480 00:29:34.834 21:30:29 -- common/autotest_common.sh@955 -- # kill 1492480 00:29:34.834 21:30:29 -- common/autotest_common.sh@960 -- # wait 1492480 00:29:35.093 [2024-04-23 21:30:29.115900] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:29:39.284 21:30:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:39.284 21:30:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:29:39.284 00:29:39.284 real 1m57.627s 00:29:39.284 user 7m30.349s 00:29:39.284 sys 0m5.682s 00:29:39.284 21:30:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:39.284 21:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:39.284 ************************************ 00:29:39.284 END TEST nvmf_perf 00:29:39.284 ************************************ 00:29:39.284 21:30:32 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:29:39.284 21:30:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:39.284 21:30:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:39.284 21:30:32 -- common/autotest_common.sh@10 -- # set +x 00:29:39.284 ************************************ 00:29:39.284 START TEST nvmf_fio_host 00:29:39.284 ************************************ 00:29:39.284 21:30:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:29:39.284 * Looking for test storage... 00:29:39.284 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:29:39.284 21:30:33 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:29:39.284 21:30:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:39.284 21:30:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:39.284 21:30:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:39.284 21:30:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@5 -- # export PATH 00:29:39.284 21:30:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:29:39.284 21:30:33 -- nvmf/common.sh@7 -- # uname -s 00:29:39.284 21:30:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:39.284 21:30:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:39.284 21:30:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:39.284 21:30:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:39.284 21:30:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:39.284 21:30:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:39.284 21:30:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:39.284 21:30:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:39.284 21:30:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:39.284 21:30:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:39.284 21:30:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:29:39.284 21:30:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:29:39.284 21:30:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:39.284 21:30:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:39.284 21:30:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:39.284 21:30:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:39.284 21:30:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:29:39.284 21:30:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:39.284 21:30:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:39.284 21:30:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:39.284 21:30:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- paths/export.sh@5 -- # export PATH 00:29:39.284 21:30:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.284 21:30:33 -- nvmf/common.sh@47 -- # : 0 00:29:39.284 21:30:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:39.284 21:30:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:39.284 21:30:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:39.284 21:30:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:39.284 21:30:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:39.284 21:30:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:39.284 21:30:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:39.284 21:30:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:39.284 21:30:33 -- host/fio.sh@12 -- # nvmftestinit 00:29:39.284 21:30:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:29:39.284 21:30:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:39.284 21:30:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:39.284 21:30:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:39.284 21:30:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:39.284 21:30:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.284 21:30:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:39.284 21:30:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.284 21:30:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:39.284 21:30:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:39.284 21:30:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:39.284 21:30:33 -- common/autotest_common.sh@10 -- # set +x 00:29:44.556 21:30:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:44.556 21:30:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:44.556 21:30:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:44.556 21:30:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:44.556 21:30:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:44.556 21:30:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:44.556 21:30:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:44.556 21:30:38 -- nvmf/common.sh@295 -- # net_devs=() 00:29:44.556 21:30:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:44.556 21:30:38 -- nvmf/common.sh@296 -- # e810=() 00:29:44.556 21:30:38 -- nvmf/common.sh@296 -- # local -ga e810 00:29:44.556 21:30:38 -- nvmf/common.sh@297 -- # x722=() 00:29:44.556 21:30:38 -- nvmf/common.sh@297 -- # local -ga x722 00:29:44.556 21:30:38 -- nvmf/common.sh@298 -- # mlx=() 00:29:44.556 21:30:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:44.556 21:30:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:44.556 21:30:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:44.556 21:30:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:29:44.556 21:30:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:29:44.556 21:30:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:29:44.556 21:30:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:44.556 21:30:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:44.556 21:30:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:29:44.556 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:29:44.556 21:30:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:44.556 21:30:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:44.556 21:30:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:44.556 21:30:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:29:44.556 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:29:44.557 21:30:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:44.557 21:30:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:44.557 21:30:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:44.557 21:30:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:29:44.557 Found net devices under 0000:18:00.0: mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:44.557 21:30:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:44.557 21:30:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:44.557 21:30:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:29:44.557 Found net devices under 0000:18:00.1: mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:44.557 21:30:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:44.557 21:30:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:29:44.557 21:30:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:29:44.557 21:30:38 -- nvmf/common.sh@58 -- # uname 00:29:44.557 21:30:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:29:44.557 21:30:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:29:44.557 21:30:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:29:44.557 21:30:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:29:44.557 21:30:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:29:44.557 21:30:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:29:44.557 21:30:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:29:44.557 21:30:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:29:44.557 21:30:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:29:44.557 21:30:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:29:44.557 21:30:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:29:44.557 21:30:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:44.557 21:30:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:44.557 21:30:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:44.557 21:30:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:44.557 21:30:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@105 -- # continue 2 00:29:44.557 21:30:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@105 -- # continue 2 00:29:44.557 21:30:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:44.557 21:30:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:44.557 21:30:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:29:44.557 21:30:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:29:44.557 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:29:44.557 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:29:44.557 altname enp24s0f0np0 00:29:44.557 altname ens785f0np0 00:29:44.557 inet 192.168.100.8/24 scope global mlx_0_0 00:29:44.557 valid_lft forever preferred_lft forever 00:29:44.557 21:30:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:44.557 21:30:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:44.557 21:30:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:29:44.557 21:30:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:29:44.557 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:29:44.557 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:29:44.557 altname enp24s0f1np1 00:29:44.557 altname ens785f1np1 00:29:44.557 inet 192.168.100.9/24 scope global mlx_0_1 00:29:44.557 valid_lft forever preferred_lft forever 00:29:44.557 21:30:38 -- nvmf/common.sh@411 -- # return 0 00:29:44.557 21:30:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:44.557 21:30:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:29:44.557 21:30:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:29:44.557 21:30:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:29:44.557 21:30:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:44.557 21:30:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:44.557 21:30:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:44.557 21:30:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:44.557 21:30:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:44.557 21:30:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@105 -- # continue 2 00:29:44.557 21:30:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:44.557 21:30:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:29:44.557 21:30:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@105 -- # continue 2 00:29:44.557 21:30:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:44.557 21:30:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:44.557 21:30:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:44.557 21:30:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:44.557 21:30:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:44.557 21:30:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:29:44.557 192.168.100.9' 00:29:44.557 21:30:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:29:44.557 192.168.100.9' 00:29:44.557 21:30:38 -- nvmf/common.sh@446 -- # head -n 1 00:29:44.557 21:30:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:29:44.557 21:30:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:29:44.557 192.168.100.9' 00:29:44.557 21:30:38 -- nvmf/common.sh@447 -- # tail -n +2 00:29:44.557 21:30:38 -- nvmf/common.sh@447 -- # head -n 1 00:29:44.557 21:30:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:29:44.557 21:30:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:29:44.557 21:30:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:29:44.557 21:30:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:29:44.557 21:30:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:29:44.557 21:30:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:29:44.557 21:30:38 -- host/fio.sh@14 -- # [[ y != y ]] 00:29:44.557 21:30:38 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:29:44.557 21:30:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:44.557 21:30:38 -- common/autotest_common.sh@10 -- # set +x 00:29:44.557 21:30:38 -- host/fio.sh@22 -- # nvmfpid=1517328 00:29:44.557 21:30:38 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:29:44.557 21:30:38 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:44.558 21:30:38 -- host/fio.sh@26 -- # waitforlisten 1517328 00:29:44.558 21:30:38 -- common/autotest_common.sh@817 -- # '[' -z 1517328 ']' 00:29:44.558 21:30:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:44.558 21:30:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:44.558 21:30:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:44.558 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:44.558 21:30:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:44.558 21:30:38 -- common/autotest_common.sh@10 -- # set +x 00:29:44.817 [2024-04-23 21:30:38.861053] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:29:44.817 [2024-04-23 21:30:38.861093] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:44.817 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.817 [2024-04-23 21:30:38.912763] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:44.817 [2024-04-23 21:30:38.979428] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:44.817 [2024-04-23 21:30:38.979470] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:44.817 [2024-04-23 21:30:38.979476] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:44.818 [2024-04-23 21:30:38.979481] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:44.818 [2024-04-23 21:30:38.979486] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:44.818 [2024-04-23 21:30:38.979533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:44.818 [2024-04-23 21:30:38.979620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:44.818 [2024-04-23 21:30:38.979707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:44.818 [2024-04-23 21:30:38.979708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:45.386 21:30:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:45.386 21:30:39 -- common/autotest_common.sh@850 -- # return 0 00:29:45.386 21:30:39 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:29:45.386 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.386 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 [2024-04-23 21:30:39.663903] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x9c96b0/0x9cdba0) succeed. 00:29:45.645 [2024-04-23 21:30:39.673282] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x9cacf0/0xa0f230) succeed. 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:29:45.645 21:30:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 21:30:39 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:29:45.645 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 Malloc1 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:45.645 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:29:45.645 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:29:45.645 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 [2024-04-23 21:30:39.866731] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:29:45.645 21:30:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:45.645 21:30:39 -- common/autotest_common.sh@10 -- # set +x 00:29:45.645 21:30:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:45.645 21:30:39 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:29:45.645 21:30:39 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:45.645 21:30:39 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:45.645 21:30:39 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:29:45.645 21:30:39 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:45.645 21:30:39 -- common/autotest_common.sh@1325 -- # local sanitizers 00:29:45.645 21:30:39 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:45.646 21:30:39 -- common/autotest_common.sh@1327 -- # shift 00:29:45.646 21:30:39 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:29:45.646 21:30:39 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # grep libasan 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:45.646 21:30:39 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:45.646 21:30:39 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:29:45.646 21:30:39 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:45.907 21:30:39 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:45.907 21:30:39 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:45.907 21:30:39 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:45.907 21:30:39 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:46.166 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:29:46.166 fio-3.35 00:29:46.166 Starting 1 thread 00:29:46.166 EAL: No free 2048 kB hugepages reported on node 1 00:29:48.699 00:29:48.699 test: (groupid=0, jobs=1): err= 0: pid=1517796: Tue Apr 23 21:30:42 2024 00:29:48.699 read: IOPS=19.4k, BW=75.7MiB/s (79.4MB/s)(152MiB/2003msec) 00:29:48.699 slat (nsec): min=1309, max=27913, avg=1451.50, stdev=399.85 00:29:48.699 clat (usec): min=1605, max=5951, avg=3281.63, stdev=79.32 00:29:48.699 lat (usec): min=1624, max=5953, avg=3283.08, stdev=79.25 00:29:48.699 clat percentiles (usec): 00:29:48.699 | 1.00th=[ 3195], 5.00th=[ 3261], 10.00th=[ 3261], 20.00th=[ 3261], 00:29:48.699 | 30.00th=[ 3261], 40.00th=[ 3261], 50.00th=[ 3294], 60.00th=[ 3294], 00:29:48.699 | 70.00th=[ 3294], 80.00th=[ 3294], 90.00th=[ 3294], 95.00th=[ 3326], 00:29:48.699 | 99.00th=[ 3326], 99.50th=[ 3589], 99.90th=[ 4293], 99.95th=[ 5080], 00:29:48.699 | 99.99th=[ 5932] 00:29:48.699 bw ( KiB/s): min=75856, max=78360, per=99.98%, avg=77520.00, stdev=1129.62, samples=4 00:29:48.699 iops : min=18964, max=19590, avg=19380.00, stdev=282.40, samples=4 00:29:48.699 write: IOPS=19.3k, BW=75.6MiB/s (79.2MB/s)(151MiB/2003msec); 0 zone resets 00:29:48.699 slat (nsec): min=1350, max=17485, avg=1716.83, stdev=473.24 00:29:48.699 clat (usec): min=2331, max=5971, avg=3279.92, stdev=76.00 00:29:48.699 lat (usec): min=2340, max=5972, avg=3281.64, stdev=75.94 00:29:48.699 clat percentiles (usec): 00:29:48.699 | 1.00th=[ 3228], 5.00th=[ 3261], 10.00th=[ 3261], 20.00th=[ 3261], 00:29:48.699 | 30.00th=[ 3261], 40.00th=[ 3261], 50.00th=[ 3294], 60.00th=[ 3294], 00:29:48.699 | 70.00th=[ 3294], 80.00th=[ 3294], 90.00th=[ 3294], 95.00th=[ 3294], 00:29:48.699 | 99.00th=[ 3326], 99.50th=[ 3589], 99.90th=[ 3884], 99.95th=[ 5080], 00:29:48.699 | 99.99th=[ 5932] 00:29:48.699 bw ( KiB/s): min=75752, max=78288, per=99.99%, avg=77378.00, stdev=1146.51, samples=4 00:29:48.699 iops : min=18938, max=19572, avg=19344.50, stdev=286.63, samples=4 00:29:48.699 lat (msec) : 2=0.01%, 4=99.89%, 10=0.10% 00:29:48.699 cpu : usr=99.60%, sys=0.00%, ctx=14, majf=0, minf=3 00:29:48.699 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:29:48.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:48.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:48.699 issued rwts: total=38827,38749,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:48.699 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:48.699 00:29:48.699 Run status group 0 (all jobs): 00:29:48.699 READ: bw=75.7MiB/s (79.4MB/s), 75.7MiB/s-75.7MiB/s (79.4MB/s-79.4MB/s), io=152MiB (159MB), run=2003-2003msec 00:29:48.699 WRITE: bw=75.6MiB/s (79.2MB/s), 75.6MiB/s-75.6MiB/s (79.2MB/s-79.2MB/s), io=151MiB (159MB), run=2003-2003msec 00:29:48.699 21:30:42 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:29:48.699 21:30:42 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:29:48.699 21:30:42 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:29:48.699 21:30:42 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:48.699 21:30:42 -- common/autotest_common.sh@1325 -- # local sanitizers 00:29:48.699 21:30:42 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:48.699 21:30:42 -- common/autotest_common.sh@1327 -- # shift 00:29:48.699 21:30:42 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:29:48.699 21:30:42 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # grep libasan 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:48.699 21:30:42 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:48.699 21:30:42 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:48.699 21:30:42 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:48.699 21:30:42 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:48.699 21:30:42 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:48.699 21:30:42 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:29:48.699 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:29:48.699 fio-3.35 00:29:48.699 Starting 1 thread 00:29:48.699 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.232 00:29:51.232 test: (groupid=0, jobs=1): err= 0: pid=1518465: Tue Apr 23 21:30:45 2024 00:29:51.232 read: IOPS=14.3k, BW=223MiB/s (234MB/s)(438MiB/1962msec) 00:29:51.232 slat (nsec): min=2125, max=43559, avg=2387.69, stdev=972.70 00:29:51.232 clat (usec): min=254, max=8770, avg=1595.00, stdev=954.72 00:29:51.232 lat (usec): min=256, max=8790, avg=1597.39, stdev=955.11 00:29:51.232 clat percentiles (usec): 00:29:51.232 | 1.00th=[ 537], 5.00th=[ 758], 10.00th=[ 881], 20.00th=[ 1029], 00:29:51.232 | 30.00th=[ 1139], 40.00th=[ 1254], 50.00th=[ 1352], 60.00th=[ 1483], 00:29:51.232 | 70.00th=[ 1647], 80.00th=[ 1844], 90.00th=[ 2278], 95.00th=[ 4080], 00:29:51.232 | 99.00th=[ 5604], 99.50th=[ 6259], 99.90th=[ 6980], 99.95th=[ 7308], 00:29:51.232 | 99.99th=[ 8717] 00:29:51.232 bw ( KiB/s): min=108480, max=114272, per=48.75%, avg=111416.00, stdev=2689.32, samples=4 00:29:51.232 iops : min= 6780, max= 7142, avg=6963.50, stdev=168.08, samples=4 00:29:51.232 write: IOPS=7801, BW=122MiB/s (128MB/s)(226MiB/1853msec); 0 zone resets 00:29:51.232 slat (usec): min=25, max=119, avg=27.75, stdev= 6.10 00:29:51.233 clat (usec): min=3662, max=19561, avg=12932.56, stdev=1617.32 00:29:51.233 lat (usec): min=3688, max=19587, avg=12960.32, stdev=1617.23 00:29:51.233 clat percentiles (usec): 00:29:51.233 | 1.00th=[ 8029], 5.00th=[10683], 10.00th=[11076], 20.00th=[11731], 00:29:51.233 | 30.00th=[12125], 40.00th=[12518], 50.00th=[12911], 60.00th=[13304], 00:29:51.233 | 70.00th=[13698], 80.00th=[14222], 90.00th=[14877], 95.00th=[15664], 00:29:51.233 | 99.00th=[16909], 99.50th=[17171], 99.90th=[17433], 99.95th=[18482], 00:29:51.233 | 99.99th=[19530] 00:29:51.233 bw ( KiB/s): min=111168, max=119872, per=92.65%, avg=115656.00, stdev=3593.17, samples=4 00:29:51.233 iops : min= 6950, max= 7490, avg=7228.50, stdev=222.96, samples=4 00:29:51.233 lat (usec) : 500=0.45%, 750=2.63%, 1000=8.62% 00:29:51.233 lat (msec) : 2=44.28%, 4=6.67%, 10=4.00%, 20=33.35% 00:29:51.233 cpu : usr=96.65%, sys=1.60%, ctx=193, majf=0, minf=2 00:29:51.233 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:29:51.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:51.233 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:29:51.233 issued rwts: total=28025,14457,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:51.233 latency : target=0, window=0, percentile=100.00%, depth=128 00:29:51.233 00:29:51.233 Run status group 0 (all jobs): 00:29:51.233 READ: bw=223MiB/s (234MB/s), 223MiB/s-223MiB/s (234MB/s-234MB/s), io=438MiB (459MB), run=1962-1962msec 00:29:51.233 WRITE: bw=122MiB/s (128MB/s), 122MiB/s-122MiB/s (128MB/s-128MB/s), io=226MiB (237MB), run=1853-1853msec 00:29:51.233 21:30:45 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:51.233 21:30:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:51.233 21:30:45 -- common/autotest_common.sh@10 -- # set +x 00:29:51.233 21:30:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:51.233 21:30:45 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:29:51.233 21:30:45 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:29:51.233 21:30:45 -- host/fio.sh@49 -- # get_nvme_bdfs 00:29:51.233 21:30:45 -- common/autotest_common.sh@1499 -- # bdfs=() 00:29:51.233 21:30:45 -- common/autotest_common.sh@1499 -- # local bdfs 00:29:51.233 21:30:45 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:29:51.233 21:30:45 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:29:51.233 21:30:45 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:29:51.233 21:30:45 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:29:51.233 21:30:45 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:29:51.233 21:30:45 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:d8:00.0 -i 192.168.100.8 00:29:51.233 21:30:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:51.233 21:30:45 -- common/autotest_common.sh@10 -- # set +x 00:29:54.517 Nvme0n1 00:29:54.517 21:30:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:54.517 21:30:48 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:29:54.518 21:30:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:54.518 21:30:48 -- common/autotest_common.sh@10 -- # set +x 00:30:04.492 21:30:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.492 21:30:58 -- host/fio.sh@51 -- # ls_guid=fe3e1482-b297-4fe5-8f5d-eb5626b5717d 00:30:04.492 21:30:58 -- host/fio.sh@52 -- # get_lvs_free_mb fe3e1482-b297-4fe5-8f5d-eb5626b5717d 00:30:04.492 21:30:58 -- common/autotest_common.sh@1350 -- # local lvs_uuid=fe3e1482-b297-4fe5-8f5d-eb5626b5717d 00:30:04.492 21:30:58 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:04.492 21:30:58 -- common/autotest_common.sh@1352 -- # local fc 00:30:04.492 21:30:58 -- common/autotest_common.sh@1353 -- # local cs 00:30:04.492 21:30:58 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:04.492 21:30:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.492 21:30:58 -- common/autotest_common.sh@10 -- # set +x 00:30:04.492 21:30:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:04.492 21:30:58 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:04.492 { 00:30:04.492 "uuid": "fe3e1482-b297-4fe5-8f5d-eb5626b5717d", 00:30:04.492 "name": "lvs_0", 00:30:04.492 "base_bdev": "Nvme0n1", 00:30:04.492 "total_data_clusters": 3725, 00:30:04.492 "free_clusters": 3725, 00:30:04.492 "block_size": 512, 00:30:04.492 "cluster_size": 1073741824 00:30:04.492 } 00:30:04.492 ]' 00:30:04.492 21:30:58 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="fe3e1482-b297-4fe5-8f5d-eb5626b5717d") .free_clusters' 00:30:04.492 21:30:58 -- common/autotest_common.sh@1355 -- # fc=3725 00:30:04.492 21:30:58 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="fe3e1482-b297-4fe5-8f5d-eb5626b5717d") .cluster_size' 00:30:04.751 21:30:58 -- common/autotest_common.sh@1356 -- # cs=1073741824 00:30:04.751 21:30:58 -- common/autotest_common.sh@1359 -- # free_mb=3814400 00:30:04.751 21:30:58 -- common/autotest_common.sh@1360 -- # echo 3814400 00:30:04.751 3814400 00:30:04.751 21:30:58 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 3814400 00:30:04.751 21:30:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:04.751 21:30:58 -- common/autotest_common.sh@10 -- # set +x 00:30:05.318 526db8f7-f624-4234-8387-1eb5a5378e55 00:30:05.318 21:30:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:05.318 21:30:59 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:30:05.318 21:30:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:05.318 21:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:05.318 21:30:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:05.318 21:30:59 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:30:05.318 21:30:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:05.318 21:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:05.318 21:30:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:05.318 21:30:59 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:30:05.318 21:30:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:05.318 21:30:59 -- common/autotest_common.sh@10 -- # set +x 00:30:05.318 21:30:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:05.318 21:30:59 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:05.318 21:30:59 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:05.318 21:30:59 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:05.318 21:30:59 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:05.318 21:30:59 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:05.318 21:30:59 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:05.318 21:30:59 -- common/autotest_common.sh@1327 -- # shift 00:30:05.318 21:30:59 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:05.318 21:30:59 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:05.318 21:30:59 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:05.318 21:30:59 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:05.318 21:30:59 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:05.318 21:30:59 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:05.318 21:30:59 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:05.318 21:30:59 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:05.577 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:05.577 fio-3.35 00:30:05.577 Starting 1 thread 00:30:05.577 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.209 00:30:08.209 test: (groupid=0, jobs=1): err= 0: pid=1522060: Tue Apr 23 21:31:02 2024 00:30:08.209 read: IOPS=7003, BW=27.4MiB/s (28.7MB/s)(54.8MiB/2004msec) 00:30:08.209 slat (nsec): min=1400, max=25175, avg=1440.44, stdev=246.59 00:30:08.209 clat (usec): min=154, max=885997, avg=9106.96, stdev=60138.37 00:30:08.209 lat (usec): min=156, max=886017, avg=9108.40, stdev=60138.44 00:30:08.209 clat percentiles (msec): 00:30:08.209 | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5], 00:30:08.209 | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 6], 60.00th=[ 6], 00:30:08.209 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:08.209 | 99.00th=[ 6], 99.50th=[ 9], 99.90th=[ 885], 99.95th=[ 885], 00:30:08.209 | 99.99th=[ 885] 00:30:08.209 bw ( KiB/s): min= 383, max=51168, per=99.72%, avg=27935.75, stdev=27024.04, samples=4 00:30:08.209 iops : min= 95, max=12792, avg=6983.75, stdev=6756.27, samples=4 00:30:08.209 write: IOPS=7008, BW=27.4MiB/s (28.7MB/s)(54.9MiB/2004msec); 0 zone resets 00:30:08.209 slat (nsec): min=1435, max=5375, avg=1513.47, stdev=161.93 00:30:08.209 clat (usec): min=345, max=886305, avg=8891.25, stdev=58270.41 00:30:08.209 lat (usec): min=346, max=886308, avg=8892.76, stdev=58270.46 00:30:08.209 clat percentiles (msec): 00:30:08.209 | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], 00:30:08.209 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:30:08.209 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:08.209 | 99.00th=[ 6], 99.50th=[ 9], 99.90th=[ 885], 99.95th=[ 885], 00:30:08.209 | 99.99th=[ 885] 00:30:08.209 bw ( KiB/s): min= 415, max=51232, per=99.77%, avg=27969.75, stdev=26906.61, samples=4 00:30:08.209 iops : min= 103, max=12808, avg=6992.25, stdev=6726.91, samples=4 00:30:08.209 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.03% 00:30:08.209 lat (msec) : 2=0.05%, 4=0.44%, 10=99.00%, 1000=0.46% 00:30:08.209 cpu : usr=99.60%, sys=0.10%, ctx=16, majf=0, minf=21 00:30:08.209 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:30:08.209 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:08.209 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:08.209 issued rwts: total=14035,14045,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:08.209 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:08.209 00:30:08.209 Run status group 0 (all jobs): 00:30:08.209 READ: bw=27.4MiB/s (28.7MB/s), 27.4MiB/s-27.4MiB/s (28.7MB/s-28.7MB/s), io=54.8MiB (57.5MB), run=2004-2004msec 00:30:08.209 WRITE: bw=27.4MiB/s (28.7MB/s), 27.4MiB/s-27.4MiB/s (28.7MB/s-28.7MB/s), io=54.9MiB (57.5MB), run=2004-2004msec 00:30:08.209 21:31:02 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:30:08.209 21:31:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:08.209 21:31:02 -- common/autotest_common.sh@10 -- # set +x 00:30:08.209 21:31:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:08.209 21:31:02 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:30:08.209 21:31:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:08.209 21:31:02 -- common/autotest_common.sh@10 -- # set +x 00:30:10.741 21:31:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:10.741 21:31:04 -- host/fio.sh@62 -- # ls_nested_guid=0176c6cb-6cbc-4767-8129-c4982ef3f391 00:30:10.741 21:31:04 -- host/fio.sh@63 -- # get_lvs_free_mb 0176c6cb-6cbc-4767-8129-c4982ef3f391 00:30:10.741 21:31:04 -- common/autotest_common.sh@1350 -- # local lvs_uuid=0176c6cb-6cbc-4767-8129-c4982ef3f391 00:30:10.741 21:31:04 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:10.741 21:31:04 -- common/autotest_common.sh@1352 -- # local fc 00:30:10.741 21:31:04 -- common/autotest_common.sh@1353 -- # local cs 00:30:10.741 21:31:04 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:10.741 21:31:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:10.741 21:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:10.741 21:31:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:10.741 21:31:04 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:10.741 { 00:30:10.741 "uuid": "fe3e1482-b297-4fe5-8f5d-eb5626b5717d", 00:30:10.741 "name": "lvs_0", 00:30:10.741 "base_bdev": "Nvme0n1", 00:30:10.741 "total_data_clusters": 3725, 00:30:10.741 "free_clusters": 0, 00:30:10.741 "block_size": 512, 00:30:10.741 "cluster_size": 1073741824 00:30:10.741 }, 00:30:10.741 { 00:30:10.741 "uuid": "0176c6cb-6cbc-4767-8129-c4982ef3f391", 00:30:10.741 "name": "lvs_n_0", 00:30:10.741 "base_bdev": "526db8f7-f624-4234-8387-1eb5a5378e55", 00:30:10.741 "total_data_clusters": 952668, 00:30:10.741 "free_clusters": 952668, 00:30:10.741 "block_size": 512, 00:30:10.741 "cluster_size": 4194304 00:30:10.741 } 00:30:10.741 ]' 00:30:10.741 21:31:04 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="0176c6cb-6cbc-4767-8129-c4982ef3f391") .free_clusters' 00:30:10.741 21:31:04 -- common/autotest_common.sh@1355 -- # fc=952668 00:30:10.741 21:31:04 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="0176c6cb-6cbc-4767-8129-c4982ef3f391") .cluster_size' 00:30:10.741 21:31:04 -- common/autotest_common.sh@1356 -- # cs=4194304 00:30:10.741 21:31:04 -- common/autotest_common.sh@1359 -- # free_mb=3810672 00:30:10.741 21:31:04 -- common/autotest_common.sh@1360 -- # echo 3810672 00:30:10.741 3810672 00:30:10.741 21:31:04 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 3810672 00:30:10.741 21:31:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:10.741 21:31:04 -- common/autotest_common.sh@10 -- # set +x 00:30:11.678 26706d87-709c-4261-bcf3-673c8e97ab97 00:30:11.678 21:31:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:11.678 21:31:05 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:30:11.678 21:31:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:11.678 21:31:05 -- common/autotest_common.sh@10 -- # set +x 00:30:11.678 21:31:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:11.678 21:31:05 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:30:11.678 21:31:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:11.678 21:31:05 -- common/autotest_common.sh@10 -- # set +x 00:30:11.678 21:31:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:11.678 21:31:05 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:30:11.678 21:31:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:11.678 21:31:05 -- common/autotest_common.sh@10 -- # set +x 00:30:11.678 21:31:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:11.678 21:31:05 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:11.678 21:31:05 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:11.678 21:31:05 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:11.678 21:31:05 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:11.678 21:31:05 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:11.678 21:31:05 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:11.678 21:31:05 -- common/autotest_common.sh@1327 -- # shift 00:30:11.678 21:31:05 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:11.678 21:31:05 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:11.678 21:31:05 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:11.678 21:31:05 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:11.678 21:31:05 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:11.678 21:31:05 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:11.678 21:31:05 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:11.678 21:31:05 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:11.936 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:11.936 fio-3.35 00:30:11.936 Starting 1 thread 00:30:11.936 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.471 00:30:14.471 test: (groupid=0, jobs=1): err= 0: pid=1523378: Tue Apr 23 21:31:08 2024 00:30:14.471 read: IOPS=10.7k, BW=41.7MiB/s (43.7MB/s)(83.5MiB/2005msec) 00:30:14.471 slat (nsec): min=1288, max=21315, avg=1383.06, stdev=243.35 00:30:14.471 clat (usec): min=2693, max=10024, avg=5905.08, stdev=178.57 00:30:14.471 lat (usec): min=2696, max=10025, avg=5906.46, stdev=178.54 00:30:14.471 clat percentiles (usec): 00:30:14.471 | 1.00th=[ 5800], 5.00th=[ 5866], 10.00th=[ 5866], 20.00th=[ 5866], 00:30:14.471 | 30.00th=[ 5866], 40.00th=[ 5866], 50.00th=[ 5932], 60.00th=[ 5932], 00:30:14.471 | 70.00th=[ 5932], 80.00th=[ 5932], 90.00th=[ 5932], 95.00th=[ 5932], 00:30:14.471 | 99.00th=[ 6063], 99.50th=[ 6128], 99.90th=[ 8586], 99.95th=[ 9896], 00:30:14.471 | 99.99th=[10028] 00:30:14.471 bw ( KiB/s): min=40368, max=43656, per=99.89%, avg=42606.00, stdev=1519.26, samples=4 00:30:14.471 iops : min=10092, max=10914, avg=10651.50, stdev=379.82, samples=4 00:30:14.471 write: IOPS=10.6k, BW=41.6MiB/s (43.6MB/s)(83.4MiB/2005msec); 0 zone resets 00:30:14.471 slat (nsec): min=1332, max=21437, avg=1723.46, stdev=344.57 00:30:14.471 clat (usec): min=2677, max=10042, avg=5921.61, stdev=152.61 00:30:14.471 lat (usec): min=2681, max=10045, avg=5923.33, stdev=152.59 00:30:14.471 clat percentiles (usec): 00:30:14.471 | 1.00th=[ 5800], 5.00th=[ 5866], 10.00th=[ 5866], 20.00th=[ 5866], 00:30:14.471 | 30.00th=[ 5932], 40.00th=[ 5932], 50.00th=[ 5932], 60.00th=[ 5932], 00:30:14.471 | 70.00th=[ 5932], 80.00th=[ 5932], 90.00th=[ 5932], 95.00th=[ 5997], 00:30:14.471 | 99.00th=[ 6063], 99.50th=[ 6128], 99.90th=[ 7111], 99.95th=[ 9503], 00:30:14.471 | 99.99th=[10028] 00:30:14.471 bw ( KiB/s): min=40848, max=43312, per=100.00%, avg=42596.00, stdev=1169.21, samples=4 00:30:14.471 iops : min=10212, max=10828, avg=10649.00, stdev=292.30, samples=4 00:30:14.471 lat (msec) : 4=0.02%, 10=99.96%, 20=0.02% 00:30:14.471 cpu : usr=99.50%, sys=0.15%, ctx=15, majf=0, minf=21 00:30:14.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:30:14.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:14.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:14.471 issued rwts: total=21379,21349,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:14.471 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:14.471 00:30:14.471 Run status group 0 (all jobs): 00:30:14.471 READ: bw=41.7MiB/s (43.7MB/s), 41.7MiB/s-41.7MiB/s (43.7MB/s-43.7MB/s), io=83.5MiB (87.6MB), run=2005-2005msec 00:30:14.471 WRITE: bw=41.6MiB/s (43.6MB/s), 41.6MiB/s-41.6MiB/s (43.6MB/s-43.6MB/s), io=83.4MiB (87.4MB), run=2005-2005msec 00:30:14.471 21:31:08 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:30:14.471 21:31:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:14.471 21:31:08 -- common/autotest_common.sh@10 -- # set +x 00:30:14.471 21:31:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:14.471 21:31:08 -- host/fio.sh@72 -- # sync 00:30:14.471 21:31:08 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:30:14.471 21:31:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:14.471 21:31:08 -- common/autotest_common.sh@10 -- # set +x 00:30:29.351 21:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:29.351 21:31:22 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:30:29.351 21:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:29.351 21:31:22 -- common/autotest_common.sh@10 -- # set +x 00:30:29.351 21:31:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:29.351 21:31:22 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:30:29.351 21:31:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:29.351 21:31:22 -- common/autotest_common.sh@10 -- # set +x 00:30:41.556 21:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:41.557 21:31:33 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:30:41.557 21:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:41.557 21:31:33 -- common/autotest_common.sh@10 -- # set +x 00:30:41.557 21:31:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:41.557 21:31:33 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:30:41.557 21:31:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:41.557 21:31:33 -- common/autotest_common.sh@10 -- # set +x 00:30:44.844 21:31:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:44.844 21:31:38 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:30:44.844 21:31:38 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:30:44.844 21:31:38 -- host/fio.sh@84 -- # nvmftestfini 00:30:44.844 21:31:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:44.844 21:31:38 -- nvmf/common.sh@117 -- # sync 00:30:44.844 21:31:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:30:44.844 21:31:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:30:44.845 21:31:38 -- nvmf/common.sh@120 -- # set +e 00:30:44.845 21:31:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:44.845 21:31:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:30:44.845 rmmod nvme_rdma 00:30:44.845 rmmod nvme_fabrics 00:30:44.845 21:31:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:44.845 21:31:38 -- nvmf/common.sh@124 -- # set -e 00:30:44.845 21:31:38 -- nvmf/common.sh@125 -- # return 0 00:30:44.845 21:31:38 -- nvmf/common.sh@478 -- # '[' -n 1517328 ']' 00:30:44.845 21:31:38 -- nvmf/common.sh@479 -- # killprocess 1517328 00:30:44.845 21:31:38 -- common/autotest_common.sh@936 -- # '[' -z 1517328 ']' 00:30:44.845 21:31:38 -- common/autotest_common.sh@940 -- # kill -0 1517328 00:30:44.845 21:31:38 -- common/autotest_common.sh@941 -- # uname 00:30:44.845 21:31:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:44.845 21:31:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1517328 00:30:44.845 21:31:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:44.845 21:31:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:44.845 21:31:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1517328' 00:30:44.845 killing process with pid 1517328 00:30:44.845 21:31:38 -- common/autotest_common.sh@955 -- # kill 1517328 00:30:44.845 21:31:38 -- common/autotest_common.sh@960 -- # wait 1517328 00:30:44.845 [2024-04-23 21:31:38.771261] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:30:44.845 21:31:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:44.845 21:31:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:30:44.845 00:30:44.845 real 1m5.864s 00:30:44.845 user 4m40.048s 00:30:44.845 sys 0m5.687s 00:30:44.845 21:31:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:44.845 21:31:38 -- common/autotest_common.sh@10 -- # set +x 00:30:44.845 ************************************ 00:30:44.845 END TEST nvmf_fio_host 00:30:44.845 ************************************ 00:30:44.845 21:31:39 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:30:44.845 21:31:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:44.845 21:31:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:44.845 21:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:45.104 ************************************ 00:30:45.104 START TEST nvmf_failover 00:30:45.104 ************************************ 00:30:45.104 21:31:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:30:45.104 * Looking for test storage... 00:30:45.104 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:30:45.104 21:31:39 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:30:45.104 21:31:39 -- nvmf/common.sh@7 -- # uname -s 00:30:45.104 21:31:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:45.104 21:31:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:45.104 21:31:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:45.104 21:31:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:45.104 21:31:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:45.104 21:31:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:45.104 21:31:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:45.104 21:31:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:45.104 21:31:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:45.104 21:31:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:45.104 21:31:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:30:45.104 21:31:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:30:45.104 21:31:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:45.104 21:31:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:45.104 21:31:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:45.104 21:31:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:45.105 21:31:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:30:45.105 21:31:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.105 21:31:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.105 21:31:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.105 21:31:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.105 21:31:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.105 21:31:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.105 21:31:39 -- paths/export.sh@5 -- # export PATH 00:30:45.105 21:31:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.105 21:31:39 -- nvmf/common.sh@47 -- # : 0 00:30:45.105 21:31:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:45.105 21:31:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:45.105 21:31:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:45.105 21:31:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:45.105 21:31:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:45.105 21:31:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:45.105 21:31:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:45.105 21:31:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:45.105 21:31:39 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:45.105 21:31:39 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:45.105 21:31:39 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:30:45.105 21:31:39 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:30:45.105 21:31:39 -- host/failover.sh@18 -- # nvmftestinit 00:30:45.105 21:31:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:30:45.105 21:31:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:45.105 21:31:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:45.105 21:31:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:45.105 21:31:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:45.105 21:31:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:45.105 21:31:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:45.105 21:31:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:45.105 21:31:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:45.105 21:31:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:45.105 21:31:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:45.105 21:31:39 -- common/autotest_common.sh@10 -- # set +x 00:30:50.382 21:31:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:50.382 21:31:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:30:50.382 21:31:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:30:50.382 21:31:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:30:50.382 21:31:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:30:50.382 21:31:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:30:50.382 21:31:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:30:50.382 21:31:44 -- nvmf/common.sh@295 -- # net_devs=() 00:30:50.382 21:31:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:30:50.382 21:31:44 -- nvmf/common.sh@296 -- # e810=() 00:30:50.382 21:31:44 -- nvmf/common.sh@296 -- # local -ga e810 00:30:50.382 21:31:44 -- nvmf/common.sh@297 -- # x722=() 00:30:50.382 21:31:44 -- nvmf/common.sh@297 -- # local -ga x722 00:30:50.382 21:31:44 -- nvmf/common.sh@298 -- # mlx=() 00:30:50.382 21:31:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:30:50.382 21:31:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:50.382 21:31:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:50.383 21:31:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:50.383 21:31:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:50.383 21:31:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:30:50.383 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:30:50.383 21:31:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:50.383 21:31:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:30:50.383 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:30:50.383 21:31:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:50.383 21:31:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:50.383 21:31:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:50.383 21:31:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:30:50.383 Found net devices under 0000:18:00.0: mlx_0_0 00:30:50.383 21:31:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:50.383 21:31:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:50.383 21:31:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:30:50.383 Found net devices under 0000:18:00.1: mlx_0_1 00:30:50.383 21:31:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:50.383 21:31:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:30:50.383 21:31:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:30:50.383 21:31:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:30:50.383 21:31:44 -- nvmf/common.sh@58 -- # uname 00:30:50.383 21:31:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:30:50.383 21:31:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:30:50.383 21:31:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:30:50.383 21:31:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:30:50.383 21:31:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:30:50.383 21:31:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:30:50.383 21:31:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:30:50.383 21:31:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:30:50.383 21:31:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:30:50.383 21:31:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:30:50.383 21:31:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:30:50.383 21:31:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:50.383 21:31:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:50.383 21:31:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:50.383 21:31:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:50.383 21:31:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:50.383 21:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:30:50.383 21:31:44 -- nvmf/common.sh@105 -- # continue 2 00:30:50.383 21:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.383 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:30:50.383 21:31:44 -- nvmf/common.sh@105 -- # continue 2 00:30:50.383 21:31:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:50.383 21:31:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:30:50.383 21:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:50.383 21:31:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:30:50.383 21:31:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:30:50.383 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:30:50.383 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:30:50.383 altname enp24s0f0np0 00:30:50.383 altname ens785f0np0 00:30:50.383 inet 192.168.100.8/24 scope global mlx_0_0 00:30:50.383 valid_lft forever preferred_lft forever 00:30:50.383 21:31:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:50.383 21:31:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:30:50.383 21:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:50.383 21:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:50.383 21:31:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:30:50.383 21:31:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:30:50.383 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:30:50.383 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:30:50.383 altname enp24s0f1np1 00:30:50.383 altname ens785f1np1 00:30:50.383 inet 192.168.100.9/24 scope global mlx_0_1 00:30:50.383 valid_lft forever preferred_lft forever 00:30:50.383 21:31:44 -- nvmf/common.sh@411 -- # return 0 00:30:50.383 21:31:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:30:50.383 21:31:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:30:50.383 21:31:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:30:50.383 21:31:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:30:50.383 21:31:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:30:50.383 21:31:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:50.383 21:31:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:50.383 21:31:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:50.383 21:31:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:50.642 21:31:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:50.642 21:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:50.642 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.642 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:30:50.642 21:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:30:50.642 21:31:44 -- nvmf/common.sh@105 -- # continue 2 00:30:50.642 21:31:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:50.642 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.642 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:30:50.642 21:31:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:50.642 21:31:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:30:50.642 21:31:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:30:50.642 21:31:44 -- nvmf/common.sh@105 -- # continue 2 00:30:50.642 21:31:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:50.642 21:31:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:30:50.642 21:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:30:50.642 21:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:30:50.642 21:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:50.642 21:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:50.642 21:31:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:50.642 21:31:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:30:50.643 21:31:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:30:50.643 21:31:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:30:50.643 21:31:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:50.643 21:31:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:50.643 21:31:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:30:50.643 192.168.100.9' 00:30:50.643 21:31:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:30:50.643 192.168.100.9' 00:30:50.643 21:31:44 -- nvmf/common.sh@446 -- # head -n 1 00:30:50.643 21:31:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:30:50.643 21:31:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:30:50.643 192.168.100.9' 00:30:50.643 21:31:44 -- nvmf/common.sh@447 -- # tail -n +2 00:30:50.643 21:31:44 -- nvmf/common.sh@447 -- # head -n 1 00:30:50.643 21:31:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:30:50.643 21:31:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:30:50.643 21:31:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:30:50.643 21:31:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:30:50.643 21:31:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:30:50.643 21:31:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:30:50.643 21:31:44 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:30:50.643 21:31:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:30:50.643 21:31:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:50.643 21:31:44 -- common/autotest_common.sh@10 -- # set +x 00:30:50.643 21:31:44 -- nvmf/common.sh@470 -- # nvmfpid=1533943 00:30:50.643 21:31:44 -- nvmf/common.sh@471 -- # waitforlisten 1533943 00:30:50.643 21:31:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:50.643 21:31:44 -- common/autotest_common.sh@817 -- # '[' -z 1533943 ']' 00:30:50.643 21:31:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:50.643 21:31:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:50.643 21:31:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:50.643 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:50.643 21:31:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:50.643 21:31:44 -- common/autotest_common.sh@10 -- # set +x 00:30:50.643 [2024-04-23 21:31:44.754104] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:30:50.643 [2024-04-23 21:31:44.754148] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:50.643 EAL: No free 2048 kB hugepages reported on node 1 00:30:50.643 [2024-04-23 21:31:44.806716] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:50.643 [2024-04-23 21:31:44.876541] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:50.643 [2024-04-23 21:31:44.876572] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:50.643 [2024-04-23 21:31:44.876579] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:50.643 [2024-04-23 21:31:44.876586] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:50.643 [2024-04-23 21:31:44.876591] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:50.643 [2024-04-23 21:31:44.878585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:50.643 [2024-04-23 21:31:44.878599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:50.643 [2024-04-23 21:31:44.878600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:51.578 21:31:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:51.578 21:31:45 -- common/autotest_common.sh@850 -- # return 0 00:30:51.578 21:31:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:30:51.578 21:31:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:51.578 21:31:45 -- common/autotest_common.sh@10 -- # set +x 00:30:51.578 21:31:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:51.578 21:31:45 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:30:51.578 [2024-04-23 21:31:45.733656] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2110ed0/0x21153c0) succeed. 00:30:51.578 [2024-04-23 21:31:45.742948] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2112470/0x2156a50) succeed. 00:30:51.837 21:31:45 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:30:51.837 Malloc0 00:30:51.837 21:31:46 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:52.095 21:31:46 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:52.354 21:31:46 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:30:52.354 [2024-04-23 21:31:46.515113] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:30:52.354 21:31:46 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:30:52.612 [2024-04-23 21:31:46.671349] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:30:52.613 21:31:46 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:30:52.613 [2024-04-23 21:31:46.835921] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:30:52.613 21:31:46 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:30:52.613 21:31:46 -- host/failover.sh@31 -- # bdevperf_pid=1534493 00:30:52.613 21:31:46 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:52.613 21:31:46 -- host/failover.sh@34 -- # waitforlisten 1534493 /var/tmp/bdevperf.sock 00:30:52.613 21:31:46 -- common/autotest_common.sh@817 -- # '[' -z 1534493 ']' 00:30:52.613 21:31:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:30:52.613 21:31:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:52.613 21:31:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:30:52.613 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:30:52.613 21:31:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:52.613 21:31:46 -- common/autotest_common.sh@10 -- # set +x 00:30:53.548 21:31:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:53.548 21:31:47 -- common/autotest_common.sh@850 -- # return 0 00:30:53.548 21:31:47 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:53.806 NVMe0n1 00:30:53.806 21:31:47 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:54.065 00:30:54.065 21:31:48 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:30:54.065 21:31:48 -- host/failover.sh@39 -- # run_test_pid=1534984 00:30:54.065 21:31:48 -- host/failover.sh@41 -- # sleep 1 00:30:55.001 21:31:49 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:30:55.260 21:31:49 -- host/failover.sh@45 -- # sleep 3 00:30:58.546 21:31:52 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:30:58.546 00:30:58.546 21:31:52 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:30:58.546 21:31:52 -- host/failover.sh@50 -- # sleep 3 00:31:01.886 21:31:55 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:01.886 [2024-04-23 21:31:55.896513] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:31:01.886 21:31:55 -- host/failover.sh@55 -- # sleep 1 00:31:02.822 21:31:56 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:02.822 21:31:57 -- host/failover.sh@59 -- # wait 1534984 00:31:09.395 0 00:31:09.395 21:32:03 -- host/failover.sh@61 -- # killprocess 1534493 00:31:09.395 21:32:03 -- common/autotest_common.sh@936 -- # '[' -z 1534493 ']' 00:31:09.395 21:32:03 -- common/autotest_common.sh@940 -- # kill -0 1534493 00:31:09.395 21:32:03 -- common/autotest_common.sh@941 -- # uname 00:31:09.395 21:32:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:09.395 21:32:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1534493 00:31:09.395 21:32:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:09.395 21:32:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:09.395 21:32:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1534493' 00:31:09.395 killing process with pid 1534493 00:31:09.395 21:32:03 -- common/autotest_common.sh@955 -- # kill 1534493 00:31:09.395 21:32:03 -- common/autotest_common.sh@960 -- # wait 1534493 00:31:09.395 21:32:03 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:09.395 [2024-04-23 21:31:46.884290] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:31:09.395 [2024-04-23 21:31:46.884332] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1534493 ] 00:31:09.395 EAL: No free 2048 kB hugepages reported on node 1 00:31:09.395 [2024-04-23 21:31:46.936577] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:09.395 [2024-04-23 21:31:47.003226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:09.395 Running I/O for 15 seconds... 00:31:09.395 [2024-04-23 21:31:50.310233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:38192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:38200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:38208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:38216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:38224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:38240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:38248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:38256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:38264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:38280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:38296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:38320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:38328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.395 [2024-04-23 21:31:50.310556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:38344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187300 00:31:09.395 [2024-04-23 21:31:50.310562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:38360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:38384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:38392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:38400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:38416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:38424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:38432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:38464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:38488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:38496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:38504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:38528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:38536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:38544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:38560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:38568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:38584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.310989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:38592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.310995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.311002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:38600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.311008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.311016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:38608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.311022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.311029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.311035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.311043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.311050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.396 [2024-04-23 21:31:50.311057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187300 00:31:09.396 [2024-04-23 21:31:50.311064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:38640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:38656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:38664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:38672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:38680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:38688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:38696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:38752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:38760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:38768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:38784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:38792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:38800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:38808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:38816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:38840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:38864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187300 00:31:09.397 [2024-04-23 21:31:50.311532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:38912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.397 [2024-04-23 21:31:50.311547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.397 [2024-04-23 21:31:50.311555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:38928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:38944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:38952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:38976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:38984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:38992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:39000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:39008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:39016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:39024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:39040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:39048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:39072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:39088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:39096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:39104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:39120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:39128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:39144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:39160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:39168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:39176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.311992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.311998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.319770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.319783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.319791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:39200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.398 [2024-04-23 21:31:50.319797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.321669] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:09.398 [2024-04-23 21:31:50.321681] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:09.398 [2024-04-23 21:31:50.321687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:39208 len:8 PRP1 0x0 PRP2 0x0 00:31:09.398 [2024-04-23 21:31:50.321694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.398 [2024-04-23 21:31:50.321732] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:31:09.398 [2024-04-23 21:31:50.321740] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:09.398 [2024-04-23 21:31:50.321747] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:09.398 [2024-04-23 21:31:50.321781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:50.321789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:50.321797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:50.321804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:50.321810] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:50.321816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:50.321822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:50.321828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:50.338107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:09.399 [2024-04-23 21:31:50.338123] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:31:09.399 [2024-04-23 21:31:50.338129] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:09.399 [2024-04-23 21:31:50.340691] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:09.399 [2024-04-23 21:31:50.371153] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:09.399 [2024-04-23 21:31:53.732680] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:53.732717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.732726] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:53.732736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.732742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:53.732748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.732755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.399 [2024-04-23 21:31:53.732760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:09.399 [2024-04-23 21:31:53.734359] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:09.399 [2024-04-23 21:31:53.734366] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:31:09.399 [2024-04-23 21:31:53.734374] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:31:09.399 [2024-04-23 21:31:53.734388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:18808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:18816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:18824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:18840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:18848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:18856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:18864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:18872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:18880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:18912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187300 00:31:09.399 [2024-04-23 21:31:53.734938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.399 [2024-04-23 21:31:53.734972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.734999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:19312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.399 [2024-04-23 21:31:53.735006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.735033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:19320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.399 [2024-04-23 21:31:53.735041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.399 [2024-04-23 21:31:53.735068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:19328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.399 [2024-04-23 21:31:53.735077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:19336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:19344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:19352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:19360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:18928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:18976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:19368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:19376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:19392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:19408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:19416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.735766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:18984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:19000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:19008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:19016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:19024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.735968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.735994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:19032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.736001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:19040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187300 00:31:09.400 [2024-04-23 21:31:53.736034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:19456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:19464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:19472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:19480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:19488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:19496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.400 [2024-04-23 21:31:53.736368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:19504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.400 [2024-04-23 21:31:53.736375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:19512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:19520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:19528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:19536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:19544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:19552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:19056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:19064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:19072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:19080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:19088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:19104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.736840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:19560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:19568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.736972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.736998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:19592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:19608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:19112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:19120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:19128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:19136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:19152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:19168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187300 00:31:09.401 [2024-04-23 21:31:53.737384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:19624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:19632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:19640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:19656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:19672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.401 [2024-04-23 21:31:53.737644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:19680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.401 [2024-04-23 21:31:53.737651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:19688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:19696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:19704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:19712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:19720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:19728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.737919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.737954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.737981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.737989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:19192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:19200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:19208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:19216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:19232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:19768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:19784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:19792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:19800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:19808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:53.738462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:19240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:19248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:19256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:19264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:19272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:19280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.738692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187300 00:31:09.402 [2024-04-23 21:31:53.738699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:48 cdw0:653941d0 sqhd:0030 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.752037] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:09.402 [2024-04-23 21:31:53.752058] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:09.402 [2024-04-23 21:31:53.752065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19296 len:8 PRP1 0x0 PRP2 0x0 00:31:09.402 [2024-04-23 21:31:53.752073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:53.752138] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:09.402 [2024-04-23 21:31:53.752146] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:09.402 [2024-04-23 21:31:53.752168] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:09.402 [2024-04-23 21:31:53.754690] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:09.402 [2024-04-23 21:31:53.796232] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:09.402 [2024-04-23 21:31:58.077774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:24872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:58.077807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:58.077824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:24880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:58.077830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.402 [2024-04-23 21:31:58.077838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.402 [2024-04-23 21:31:58.077844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:24904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:24912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:24920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:24936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:24952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:24960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:24968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.077992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:24976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.077998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:24288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:24992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:25000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:25008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:25016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:25032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:25056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:25064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:25072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:25080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:25096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.403 [2024-04-23 21:31:58.078253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:24304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:24320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:24336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:24352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.403 [2024-04-23 21:31:58.078357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:24360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187300 00:31:09.403 [2024-04-23 21:31:58.078363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:24368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:24376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:24392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:24416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:24432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:24448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:24456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:24464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:24472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:24496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:24512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:24520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:24536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:24552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:24560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:24576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:24584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:24600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187300 00:31:09.404 [2024-04-23 21:31:58.078782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.404 [2024-04-23 21:31:58.078789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:24616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:24624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:24632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:24648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:24656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:24664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:24680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.078904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:25112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:25120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:25136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:25144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.078989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:25160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.078996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:24688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:24720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:25176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:25184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:25192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:25200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:25208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:25216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:25224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:24728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:24736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:24744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:24752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:24768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:24776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187300 00:31:09.405 [2024-04-23 21:31:58.079273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.405 [2024-04-23 21:31:58.079284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:25232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.405 [2024-04-23 21:31:58.079290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:25264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:25272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:25280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:25296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:09.406 [2024-04-23 21:31:58.079396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:24800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:24808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:24824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:24832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:24840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:24848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.079510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:24856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187300 00:31:09.406 [2024-04-23 21:31:58.079516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:43c0 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.089797] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:09.406 [2024-04-23 21:31:58.089810] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:09.406 [2024-04-23 21:31:58.089817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24864 len:8 PRP1 0x0 PRP2 0x0 00:31:09.406 [2024-04-23 21:31:58.089824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.089864] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:09.406 [2024-04-23 21:31:58.089872] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:31:09.406 [2024-04-23 21:31:58.089880] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:09.406 [2024-04-23 21:31:58.089912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.406 [2024-04-23 21:31:58.089920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.089930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.406 [2024-04-23 21:31:58.089937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.089945] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.406 [2024-04-23 21:31:58.089952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.089960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:09.406 [2024-04-23 21:31:58.089967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:09.406 [2024-04-23 21:31:58.106590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:09.406 [2024-04-23 21:31:58.106610] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:31:09.406 [2024-04-23 21:31:58.106617] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:09.406 [2024-04-23 21:31:58.109168] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:09.406 [2024-04-23 21:31:58.137926] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:09.406 00:31:09.406 Latency(us) 00:31:09.406 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:09.406 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:09.406 Verification LBA range: start 0x0 length 0x4000 00:31:09.406 NVMe0n1 : 15.00 15520.39 60.63 245.53 0.00 8096.68 324.65 1043915.66 00:31:09.406 =================================================================================================================== 00:31:09.406 Total : 15520.39 60.63 245.53 0.00 8096.68 324.65 1043915.66 00:31:09.406 Received shutdown signal, test time was about 15.000000 seconds 00:31:09.406 00:31:09.406 Latency(us) 00:31:09.406 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:09.406 =================================================================================================================== 00:31:09.406 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:09.406 21:32:03 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:31:09.406 21:32:03 -- host/failover.sh@65 -- # count=3 00:31:09.406 21:32:03 -- host/failover.sh@67 -- # (( count != 3 )) 00:31:09.406 21:32:03 -- host/failover.sh@73 -- # bdevperf_pid=1539142 00:31:09.406 21:32:03 -- host/failover.sh@75 -- # waitforlisten 1539142 /var/tmp/bdevperf.sock 00:31:09.406 21:32:03 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:31:09.406 21:32:03 -- common/autotest_common.sh@817 -- # '[' -z 1539142 ']' 00:31:09.406 21:32:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:31:09.406 21:32:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:09.406 21:32:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:31:09.406 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:31:09.406 21:32:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:09.406 21:32:03 -- common/autotest_common.sh@10 -- # set +x 00:31:10.343 21:32:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:10.343 21:32:04 -- common/autotest_common.sh@850 -- # return 0 00:31:10.343 21:32:04 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:10.343 [2024-04-23 21:32:04.505745] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:31:10.343 21:32:04 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:10.601 [2024-04-23 21:32:04.678349] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:31:10.601 21:32:04 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:10.860 NVMe0n1 00:31:10.860 21:32:04 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:11.118 00:31:11.119 21:32:05 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:11.119 00:31:11.377 21:32:05 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:11.377 21:32:05 -- host/failover.sh@82 -- # grep -q NVMe0 00:31:11.377 21:32:05 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:11.636 21:32:05 -- host/failover.sh@87 -- # sleep 3 00:31:14.923 21:32:08 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:14.923 21:32:08 -- host/failover.sh@88 -- # grep -q NVMe0 00:31:14.923 21:32:08 -- host/failover.sh@90 -- # run_test_pid=1540618 00:31:14.923 21:32:08 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:31:14.923 21:32:08 -- host/failover.sh@92 -- # wait 1540618 00:31:15.858 0 00:31:15.858 21:32:10 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:15.858 [2024-04-23 21:32:03.594607] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:31:15.858 [2024-04-23 21:32:03.594648] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1539142 ] 00:31:15.858 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.858 [2024-04-23 21:32:03.644901] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:15.858 [2024-04-23 21:32:03.706824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:15.858 [2024-04-23 21:32:05.700946] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:15.858 [2024-04-23 21:32:05.701521] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:15.858 [2024-04-23 21:32:05.701549] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:15.858 [2024-04-23 21:32:05.716592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:15.858 [2024-04-23 21:32:05.732568] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:15.858 Running I/O for 1 seconds... 00:31:15.858 00:31:15.858 Latency(us) 00:31:15.858 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:15.858 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:15.858 Verification LBA range: start 0x0 length 0x4000 00:31:15.858 NVMe0n1 : 1.00 19384.34 75.72 0.00 0.00 6568.95 2330.17 17961.72 00:31:15.858 =================================================================================================================== 00:31:15.858 Total : 19384.34 75.72 0.00 0.00 6568.95 2330.17 17961.72 00:31:15.858 21:32:10 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:15.858 21:32:10 -- host/failover.sh@95 -- # grep -q NVMe0 00:31:16.117 21:32:10 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:16.117 21:32:10 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:16.117 21:32:10 -- host/failover.sh@99 -- # grep -q NVMe0 00:31:16.375 21:32:10 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:16.633 21:32:10 -- host/failover.sh@101 -- # sleep 3 00:31:19.915 21:32:13 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:19.915 21:32:13 -- host/failover.sh@103 -- # grep -q NVMe0 00:31:19.915 21:32:13 -- host/failover.sh@108 -- # killprocess 1539142 00:31:19.915 21:32:13 -- common/autotest_common.sh@936 -- # '[' -z 1539142 ']' 00:31:19.915 21:32:13 -- common/autotest_common.sh@940 -- # kill -0 1539142 00:31:19.915 21:32:13 -- common/autotest_common.sh@941 -- # uname 00:31:19.915 21:32:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:19.915 21:32:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1539142 00:31:19.915 21:32:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:19.915 21:32:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:19.915 21:32:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1539142' 00:31:19.915 killing process with pid 1539142 00:31:19.915 21:32:13 -- common/autotest_common.sh@955 -- # kill 1539142 00:31:19.915 21:32:13 -- common/autotest_common.sh@960 -- # wait 1539142 00:31:19.915 21:32:14 -- host/failover.sh@110 -- # sync 00:31:19.915 21:32:14 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:20.173 21:32:14 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:31:20.173 21:32:14 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:20.173 21:32:14 -- host/failover.sh@116 -- # nvmftestfini 00:31:20.173 21:32:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:20.173 21:32:14 -- nvmf/common.sh@117 -- # sync 00:31:20.173 21:32:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:20.173 21:32:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:20.173 21:32:14 -- nvmf/common.sh@120 -- # set +e 00:31:20.173 21:32:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:20.173 21:32:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:20.173 rmmod nvme_rdma 00:31:20.173 rmmod nvme_fabrics 00:31:20.173 21:32:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:20.173 21:32:14 -- nvmf/common.sh@124 -- # set -e 00:31:20.173 21:32:14 -- nvmf/common.sh@125 -- # return 0 00:31:20.173 21:32:14 -- nvmf/common.sh@478 -- # '[' -n 1533943 ']' 00:31:20.173 21:32:14 -- nvmf/common.sh@479 -- # killprocess 1533943 00:31:20.173 21:32:14 -- common/autotest_common.sh@936 -- # '[' -z 1533943 ']' 00:31:20.173 21:32:14 -- common/autotest_common.sh@940 -- # kill -0 1533943 00:31:20.173 21:32:14 -- common/autotest_common.sh@941 -- # uname 00:31:20.173 21:32:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:20.173 21:32:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1533943 00:31:20.173 21:32:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:20.173 21:32:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:20.173 21:32:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1533943' 00:31:20.173 killing process with pid 1533943 00:31:20.173 21:32:14 -- common/autotest_common.sh@955 -- # kill 1533943 00:31:20.173 21:32:14 -- common/autotest_common.sh@960 -- # wait 1533943 00:31:20.431 [2024-04-23 21:32:14.480734] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:31:20.431 21:32:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:20.431 21:32:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:20.431 00:31:20.431 real 0m35.550s 00:31:20.431 user 2m1.724s 00:31:20.431 sys 0m5.905s 00:31:20.431 21:32:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:20.431 21:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:20.432 ************************************ 00:31:20.432 END TEST nvmf_failover 00:31:20.432 ************************************ 00:31:20.690 21:32:14 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:20.691 21:32:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:20.691 21:32:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:20.691 21:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:20.691 ************************************ 00:31:20.691 START TEST nvmf_discovery 00:31:20.691 ************************************ 00:31:20.691 21:32:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:20.691 * Looking for test storage... 00:31:20.691 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:20.691 21:32:14 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:20.691 21:32:14 -- nvmf/common.sh@7 -- # uname -s 00:31:20.691 21:32:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:20.691 21:32:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:20.691 21:32:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:20.691 21:32:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:20.691 21:32:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:20.691 21:32:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:20.691 21:32:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:20.691 21:32:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:20.691 21:32:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:20.691 21:32:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:20.691 21:32:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:20.691 21:32:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:20.691 21:32:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:20.691 21:32:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:20.691 21:32:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:20.691 21:32:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:20.691 21:32:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:20.691 21:32:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:20.691 21:32:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:20.691 21:32:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:20.691 21:32:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.691 21:32:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.691 21:32:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.691 21:32:14 -- paths/export.sh@5 -- # export PATH 00:31:20.691 21:32:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:20.691 21:32:14 -- nvmf/common.sh@47 -- # : 0 00:31:20.691 21:32:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:20.691 21:32:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:20.691 21:32:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:20.691 21:32:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:20.691 21:32:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:20.691 21:32:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:20.691 21:32:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:20.691 21:32:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:20.691 21:32:14 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:31:20.691 21:32:14 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:20.691 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:20.691 21:32:14 -- host/discovery.sh@13 -- # exit 0 00:31:20.691 00:31:20.691 real 0m0.104s 00:31:20.691 user 0m0.050s 00:31:20.691 sys 0m0.062s 00:31:20.691 21:32:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:20.691 21:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:20.691 ************************************ 00:31:20.691 END TEST nvmf_discovery 00:31:20.691 ************************************ 00:31:20.950 21:32:14 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:20.950 21:32:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:20.950 21:32:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:20.950 21:32:14 -- common/autotest_common.sh@10 -- # set +x 00:31:20.950 ************************************ 00:31:20.950 START TEST nvmf_discovery_remove_ifc 00:31:20.950 ************************************ 00:31:20.950 21:32:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:20.950 * Looking for test storage... 00:31:20.950 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:20.950 21:32:15 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:20.950 21:32:15 -- nvmf/common.sh@7 -- # uname -s 00:31:20.950 21:32:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:20.950 21:32:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:20.950 21:32:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:20.950 21:32:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:20.950 21:32:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:20.950 21:32:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:20.950 21:32:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:20.950 21:32:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:20.950 21:32:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:20.950 21:32:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:20.950 21:32:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:20.950 21:32:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:20.950 21:32:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:20.950 21:32:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:20.950 21:32:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:20.950 21:32:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:20.950 21:32:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:21.211 21:32:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:21.211 21:32:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:21.211 21:32:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:21.211 21:32:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.211 21:32:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.211 21:32:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.211 21:32:15 -- paths/export.sh@5 -- # export PATH 00:31:21.211 21:32:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.211 21:32:15 -- nvmf/common.sh@47 -- # : 0 00:31:21.211 21:32:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:21.211 21:32:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:21.211 21:32:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:21.211 21:32:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:21.211 21:32:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:21.211 21:32:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:21.211 21:32:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:21.211 21:32:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:21.211 21:32:15 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:31:21.211 21:32:15 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:21.211 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:21.211 21:32:15 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:31:21.211 00:31:21.211 real 0m0.116s 00:31:21.211 user 0m0.053s 00:31:21.211 sys 0m0.072s 00:31:21.211 21:32:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:21.211 21:32:15 -- common/autotest_common.sh@10 -- # set +x 00:31:21.211 ************************************ 00:31:21.211 END TEST nvmf_discovery_remove_ifc 00:31:21.211 ************************************ 00:31:21.211 21:32:15 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:21.211 21:32:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:21.211 21:32:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:21.211 21:32:15 -- common/autotest_common.sh@10 -- # set +x 00:31:21.211 ************************************ 00:31:21.211 START TEST nvmf_identify_kernel_target 00:31:21.211 ************************************ 00:31:21.211 21:32:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:21.211 * Looking for test storage... 00:31:21.211 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:21.211 21:32:15 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:21.211 21:32:15 -- nvmf/common.sh@7 -- # uname -s 00:31:21.211 21:32:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:21.211 21:32:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:21.211 21:32:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:21.211 21:32:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:21.211 21:32:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:21.211 21:32:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:21.211 21:32:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:21.211 21:32:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:21.211 21:32:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:21.470 21:32:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:21.470 21:32:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:21.470 21:32:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:21.470 21:32:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:21.470 21:32:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:21.470 21:32:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:21.470 21:32:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:21.470 21:32:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:21.470 21:32:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:21.470 21:32:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:21.470 21:32:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:21.470 21:32:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.470 21:32:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.470 21:32:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.470 21:32:15 -- paths/export.sh@5 -- # export PATH 00:31:21.470 21:32:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:21.470 21:32:15 -- nvmf/common.sh@47 -- # : 0 00:31:21.470 21:32:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:21.470 21:32:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:21.470 21:32:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:21.470 21:32:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:21.470 21:32:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:21.470 21:32:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:21.470 21:32:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:21.470 21:32:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:21.470 21:32:15 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:31:21.470 21:32:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:21.470 21:32:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:21.470 21:32:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:21.470 21:32:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:21.470 21:32:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:21.470 21:32:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:21.470 21:32:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:21.470 21:32:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:21.470 21:32:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:21.470 21:32:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:21.470 21:32:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:21.470 21:32:15 -- common/autotest_common.sh@10 -- # set +x 00:31:26.740 21:32:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:26.740 21:32:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:26.740 21:32:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:26.740 21:32:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:26.740 21:32:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:26.740 21:32:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:26.740 21:32:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:26.740 21:32:20 -- nvmf/common.sh@295 -- # net_devs=() 00:31:26.740 21:32:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:26.740 21:32:20 -- nvmf/common.sh@296 -- # e810=() 00:31:26.740 21:32:20 -- nvmf/common.sh@296 -- # local -ga e810 00:31:26.740 21:32:20 -- nvmf/common.sh@297 -- # x722=() 00:31:26.740 21:32:20 -- nvmf/common.sh@297 -- # local -ga x722 00:31:26.740 21:32:20 -- nvmf/common.sh@298 -- # mlx=() 00:31:26.740 21:32:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:26.740 21:32:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:26.740 21:32:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:26.740 21:32:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:26.740 21:32:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:26.740 21:32:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:31:26.740 21:32:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:26.740 21:32:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:26.740 21:32:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:31:26.740 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:31:26.740 21:32:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:26.740 21:32:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:26.740 21:32:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:31:26.740 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:31:26.740 21:32:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:26.740 21:32:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:26.741 21:32:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:26.741 21:32:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:26.741 21:32:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:31:26.741 Found net devices under 0000:18:00.0: mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:26.741 21:32:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:26.741 21:32:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:26.741 21:32:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:31:26.741 Found net devices under 0000:18:00.1: mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:26.741 21:32:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:26.741 21:32:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:26.741 21:32:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:26.741 21:32:20 -- nvmf/common.sh@58 -- # uname 00:31:26.741 21:32:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:26.741 21:32:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:26.741 21:32:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:26.741 21:32:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:26.741 21:32:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:26.741 21:32:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:26.741 21:32:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:26.741 21:32:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:26.741 21:32:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:26.741 21:32:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:26.741 21:32:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:26.741 21:32:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:26.741 21:32:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:26.741 21:32:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:26.741 21:32:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:26.741 21:32:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@105 -- # continue 2 00:31:26.741 21:32:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@105 -- # continue 2 00:31:26.741 21:32:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:26.741 21:32:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:26.741 21:32:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:26.741 21:32:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:31:26.741 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:26.741 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:31:26.741 altname enp24s0f0np0 00:31:26.741 altname ens785f0np0 00:31:26.741 inet 192.168.100.8/24 scope global mlx_0_0 00:31:26.741 valid_lft forever preferred_lft forever 00:31:26.741 21:32:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:26.741 21:32:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:26.741 21:32:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:26.741 21:32:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:31:26.741 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:26.741 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:31:26.741 altname enp24s0f1np1 00:31:26.741 altname ens785f1np1 00:31:26.741 inet 192.168.100.9/24 scope global mlx_0_1 00:31:26.741 valid_lft forever preferred_lft forever 00:31:26.741 21:32:20 -- nvmf/common.sh@411 -- # return 0 00:31:26.741 21:32:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:26.741 21:32:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:26.741 21:32:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:26.741 21:32:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:26.741 21:32:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:26.741 21:32:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:26.741 21:32:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:26.741 21:32:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:26.741 21:32:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:26.741 21:32:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@105 -- # continue 2 00:31:26.741 21:32:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:26.741 21:32:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@105 -- # continue 2 00:31:26.741 21:32:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:26.741 21:32:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:26.741 21:32:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:26.741 21:32:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:26.741 21:32:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:26.741 21:32:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:26.741 192.168.100.9' 00:31:26.741 21:32:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:26.741 192.168.100.9' 00:31:26.741 21:32:20 -- nvmf/common.sh@446 -- # head -n 1 00:31:26.741 21:32:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:26.741 21:32:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:26.741 192.168.100.9' 00:31:26.741 21:32:20 -- nvmf/common.sh@447 -- # tail -n +2 00:31:26.741 21:32:20 -- nvmf/common.sh@447 -- # head -n 1 00:31:26.741 21:32:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:26.741 21:32:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:26.741 21:32:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:26.741 21:32:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:26.741 21:32:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:26.741 21:32:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:26.741 21:32:20 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:31:26.741 21:32:20 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:31:26.741 21:32:20 -- nvmf/common.sh@717 -- # local ip 00:31:26.741 21:32:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:26.741 21:32:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:26.741 21:32:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:26.741 21:32:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:26.741 21:32:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:26.741 21:32:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:26.741 21:32:20 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:31:26.741 21:32:20 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:31:26.741 21:32:20 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:31:26.741 21:32:20 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:31:26.741 21:32:20 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:26.741 21:32:20 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:26.741 21:32:20 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:31:26.741 21:32:20 -- nvmf/common.sh@628 -- # local block nvme 00:31:26.741 21:32:20 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@631 -- # modprobe nvmet 00:31:26.741 21:32:20 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:31:26.741 21:32:20 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:31:28.647 Waiting for block devices as requested 00:31:28.647 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:28.647 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:28.647 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:28.647 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:28.904 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:28.904 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:28.904 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:28.904 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:29.162 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:29.162 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:29.162 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:29.421 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:29.421 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:29.421 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:29.421 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:29.680 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:29.680 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:31:31.058 21:32:25 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:31:31.058 21:32:25 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:31:31.058 21:32:25 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:31:31.058 21:32:25 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:31:31.058 21:32:25 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:31:31.058 21:32:25 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:31:31.058 21:32:25 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:31:31.058 21:32:25 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:31:31.058 21:32:25 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:31:31.058 No valid GPT data, bailing 00:31:31.058 21:32:25 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:31:31.058 21:32:25 -- scripts/common.sh@391 -- # pt= 00:31:31.058 21:32:25 -- scripts/common.sh@392 -- # return 1 00:31:31.058 21:32:25 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:31:31.058 21:32:25 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:31:31.058 21:32:25 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:31.058 21:32:25 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:31.058 21:32:25 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:31:31.058 21:32:25 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:31:31.058 21:32:25 -- nvmf/common.sh@656 -- # echo 1 00:31:31.058 21:32:25 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:31:31.058 21:32:25 -- nvmf/common.sh@658 -- # echo 1 00:31:31.058 21:32:25 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:31:31.058 21:32:25 -- nvmf/common.sh@661 -- # echo rdma 00:31:31.058 21:32:25 -- nvmf/common.sh@662 -- # echo 4420 00:31:31.058 21:32:25 -- nvmf/common.sh@663 -- # echo ipv4 00:31:31.058 21:32:25 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:31:31.058 21:32:25 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:31:31.319 00:31:31.319 Discovery Log Number of Records 2, Generation counter 2 00:31:31.319 =====Discovery Log Entry 0====== 00:31:31.319 trtype: rdma 00:31:31.319 adrfam: ipv4 00:31:31.319 subtype: current discovery subsystem 00:31:31.319 treq: not specified, sq flow control disable supported 00:31:31.319 portid: 1 00:31:31.319 trsvcid: 4420 00:31:31.319 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:31:31.319 traddr: 192.168.100.8 00:31:31.319 eflags: none 00:31:31.319 rdma_prtype: not specified 00:31:31.319 rdma_qptype: connected 00:31:31.319 rdma_cms: rdma-cm 00:31:31.319 rdma_pkey: 0x0000 00:31:31.319 =====Discovery Log Entry 1====== 00:31:31.319 trtype: rdma 00:31:31.319 adrfam: ipv4 00:31:31.319 subtype: nvme subsystem 00:31:31.319 treq: not specified, sq flow control disable supported 00:31:31.319 portid: 1 00:31:31.319 trsvcid: 4420 00:31:31.319 subnqn: nqn.2016-06.io.spdk:testnqn 00:31:31.319 traddr: 192.168.100.8 00:31:31.319 eflags: none 00:31:31.319 rdma_prtype: not specified 00:31:31.319 rdma_qptype: connected 00:31:31.319 rdma_cms: rdma-cm 00:31:31.319 rdma_pkey: 0x0000 00:31:31.319 21:32:25 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:31:31.319 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:31:31.319 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.319 ===================================================== 00:31:31.319 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:31:31.319 ===================================================== 00:31:31.319 Controller Capabilities/Features 00:31:31.319 ================================ 00:31:31.319 Vendor ID: 0000 00:31:31.319 Subsystem Vendor ID: 0000 00:31:31.319 Serial Number: 3bc51b587631dcfab0d3 00:31:31.319 Model Number: Linux 00:31:31.319 Firmware Version: 6.7.0-68 00:31:31.319 Recommended Arb Burst: 0 00:31:31.319 IEEE OUI Identifier: 00 00 00 00:31:31.319 Multi-path I/O 00:31:31.319 May have multiple subsystem ports: No 00:31:31.319 May have multiple controllers: No 00:31:31.319 Associated with SR-IOV VF: No 00:31:31.319 Max Data Transfer Size: Unlimited 00:31:31.319 Max Number of Namespaces: 0 00:31:31.319 Max Number of I/O Queues: 1024 00:31:31.319 NVMe Specification Version (VS): 1.3 00:31:31.319 NVMe Specification Version (Identify): 1.3 00:31:31.319 Maximum Queue Entries: 128 00:31:31.319 Contiguous Queues Required: No 00:31:31.319 Arbitration Mechanisms Supported 00:31:31.319 Weighted Round Robin: Not Supported 00:31:31.319 Vendor Specific: Not Supported 00:31:31.319 Reset Timeout: 7500 ms 00:31:31.319 Doorbell Stride: 4 bytes 00:31:31.319 NVM Subsystem Reset: Not Supported 00:31:31.319 Command Sets Supported 00:31:31.319 NVM Command Set: Supported 00:31:31.319 Boot Partition: Not Supported 00:31:31.319 Memory Page Size Minimum: 4096 bytes 00:31:31.319 Memory Page Size Maximum: 4096 bytes 00:31:31.319 Persistent Memory Region: Not Supported 00:31:31.319 Optional Asynchronous Events Supported 00:31:31.319 Namespace Attribute Notices: Not Supported 00:31:31.319 Firmware Activation Notices: Not Supported 00:31:31.319 ANA Change Notices: Not Supported 00:31:31.319 PLE Aggregate Log Change Notices: Not Supported 00:31:31.319 LBA Status Info Alert Notices: Not Supported 00:31:31.319 EGE Aggregate Log Change Notices: Not Supported 00:31:31.319 Normal NVM Subsystem Shutdown event: Not Supported 00:31:31.319 Zone Descriptor Change Notices: Not Supported 00:31:31.319 Discovery Log Change Notices: Supported 00:31:31.319 Controller Attributes 00:31:31.319 128-bit Host Identifier: Not Supported 00:31:31.319 Non-Operational Permissive Mode: Not Supported 00:31:31.319 NVM Sets: Not Supported 00:31:31.319 Read Recovery Levels: Not Supported 00:31:31.319 Endurance Groups: Not Supported 00:31:31.319 Predictable Latency Mode: Not Supported 00:31:31.319 Traffic Based Keep ALive: Not Supported 00:31:31.319 Namespace Granularity: Not Supported 00:31:31.319 SQ Associations: Not Supported 00:31:31.319 UUID List: Not Supported 00:31:31.319 Multi-Domain Subsystem: Not Supported 00:31:31.319 Fixed Capacity Management: Not Supported 00:31:31.319 Variable Capacity Management: Not Supported 00:31:31.319 Delete Endurance Group: Not Supported 00:31:31.319 Delete NVM Set: Not Supported 00:31:31.319 Extended LBA Formats Supported: Not Supported 00:31:31.319 Flexible Data Placement Supported: Not Supported 00:31:31.319 00:31:31.319 Controller Memory Buffer Support 00:31:31.319 ================================ 00:31:31.319 Supported: No 00:31:31.319 00:31:31.319 Persistent Memory Region Support 00:31:31.319 ================================ 00:31:31.319 Supported: No 00:31:31.319 00:31:31.319 Admin Command Set Attributes 00:31:31.319 ============================ 00:31:31.319 Security Send/Receive: Not Supported 00:31:31.319 Format NVM: Not Supported 00:31:31.319 Firmware Activate/Download: Not Supported 00:31:31.319 Namespace Management: Not Supported 00:31:31.319 Device Self-Test: Not Supported 00:31:31.319 Directives: Not Supported 00:31:31.319 NVMe-MI: Not Supported 00:31:31.319 Virtualization Management: Not Supported 00:31:31.319 Doorbell Buffer Config: Not Supported 00:31:31.319 Get LBA Status Capability: Not Supported 00:31:31.319 Command & Feature Lockdown Capability: Not Supported 00:31:31.319 Abort Command Limit: 1 00:31:31.319 Async Event Request Limit: 1 00:31:31.319 Number of Firmware Slots: N/A 00:31:31.319 Firmware Slot 1 Read-Only: N/A 00:31:31.319 Firmware Activation Without Reset: N/A 00:31:31.319 Multiple Update Detection Support: N/A 00:31:31.319 Firmware Update Granularity: No Information Provided 00:31:31.319 Per-Namespace SMART Log: No 00:31:31.319 Asymmetric Namespace Access Log Page: Not Supported 00:31:31.319 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:31:31.319 Command Effects Log Page: Not Supported 00:31:31.319 Get Log Page Extended Data: Supported 00:31:31.319 Telemetry Log Pages: Not Supported 00:31:31.319 Persistent Event Log Pages: Not Supported 00:31:31.319 Supported Log Pages Log Page: May Support 00:31:31.319 Commands Supported & Effects Log Page: Not Supported 00:31:31.319 Feature Identifiers & Effects Log Page:May Support 00:31:31.319 NVMe-MI Commands & Effects Log Page: May Support 00:31:31.319 Data Area 4 for Telemetry Log: Not Supported 00:31:31.319 Error Log Page Entries Supported: 1 00:31:31.319 Keep Alive: Not Supported 00:31:31.319 00:31:31.319 NVM Command Set Attributes 00:31:31.319 ========================== 00:31:31.319 Submission Queue Entry Size 00:31:31.319 Max: 1 00:31:31.319 Min: 1 00:31:31.319 Completion Queue Entry Size 00:31:31.319 Max: 1 00:31:31.319 Min: 1 00:31:31.319 Number of Namespaces: 0 00:31:31.319 Compare Command: Not Supported 00:31:31.319 Write Uncorrectable Command: Not Supported 00:31:31.319 Dataset Management Command: Not Supported 00:31:31.319 Write Zeroes Command: Not Supported 00:31:31.319 Set Features Save Field: Not Supported 00:31:31.319 Reservations: Not Supported 00:31:31.319 Timestamp: Not Supported 00:31:31.319 Copy: Not Supported 00:31:31.319 Volatile Write Cache: Not Present 00:31:31.319 Atomic Write Unit (Normal): 1 00:31:31.319 Atomic Write Unit (PFail): 1 00:31:31.319 Atomic Compare & Write Unit: 1 00:31:31.319 Fused Compare & Write: Not Supported 00:31:31.319 Scatter-Gather List 00:31:31.319 SGL Command Set: Supported 00:31:31.319 SGL Keyed: Supported 00:31:31.319 SGL Bit Bucket Descriptor: Not Supported 00:31:31.319 SGL Metadata Pointer: Not Supported 00:31:31.319 Oversized SGL: Not Supported 00:31:31.319 SGL Metadata Address: Not Supported 00:31:31.319 SGL Offset: Supported 00:31:31.319 Transport SGL Data Block: Not Supported 00:31:31.319 Replay Protected Memory Block: Not Supported 00:31:31.319 00:31:31.319 Firmware Slot Information 00:31:31.319 ========================= 00:31:31.319 Active slot: 0 00:31:31.319 00:31:31.320 00:31:31.320 Error Log 00:31:31.320 ========= 00:31:31.320 00:31:31.320 Active Namespaces 00:31:31.320 ================= 00:31:31.320 Discovery Log Page 00:31:31.320 ================== 00:31:31.320 Generation Counter: 2 00:31:31.320 Number of Records: 2 00:31:31.320 Record Format: 0 00:31:31.320 00:31:31.320 Discovery Log Entry 0 00:31:31.320 ---------------------- 00:31:31.320 Transport Type: 1 (RDMA) 00:31:31.320 Address Family: 1 (IPv4) 00:31:31.320 Subsystem Type: 3 (Current Discovery Subsystem) 00:31:31.320 Entry Flags: 00:31:31.320 Duplicate Returned Information: 0 00:31:31.320 Explicit Persistent Connection Support for Discovery: 0 00:31:31.320 Transport Requirements: 00:31:31.320 Secure Channel: Not Specified 00:31:31.320 Port ID: 1 (0x0001) 00:31:31.320 Controller ID: 65535 (0xffff) 00:31:31.320 Admin Max SQ Size: 32 00:31:31.320 Transport Service Identifier: 4420 00:31:31.320 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:31:31.320 Transport Address: 192.168.100.8 00:31:31.320 Transport Specific Address Subtype - RDMA 00:31:31.320 RDMA QP Service Type: 1 (Reliable Connected) 00:31:31.320 RDMA Provider Type: 1 (No provider specified) 00:31:31.320 RDMA CM Service: 1 (RDMA_CM) 00:31:31.320 Discovery Log Entry 1 00:31:31.320 ---------------------- 00:31:31.320 Transport Type: 1 (RDMA) 00:31:31.320 Address Family: 1 (IPv4) 00:31:31.320 Subsystem Type: 2 (NVM Subsystem) 00:31:31.320 Entry Flags: 00:31:31.320 Duplicate Returned Information: 0 00:31:31.320 Explicit Persistent Connection Support for Discovery: 0 00:31:31.320 Transport Requirements: 00:31:31.320 Secure Channel: Not Specified 00:31:31.320 Port ID: 1 (0x0001) 00:31:31.320 Controller ID: 65535 (0xffff) 00:31:31.320 Admin Max SQ Size: 32 00:31:31.320 Transport Service Identifier: 4420 00:31:31.320 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:31:31.320 Transport Address: 192.168.100.8 00:31:31.320 Transport Specific Address Subtype - RDMA 00:31:31.320 RDMA QP Service Type: 1 (Reliable Connected) 00:31:31.320 RDMA Provider Type: 1 (No provider specified) 00:31:31.320 RDMA CM Service: 1 (RDMA_CM) 00:31:31.320 21:32:25 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:31:31.320 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.320 get_feature(0x01) failed 00:31:31.320 get_feature(0x02) failed 00:31:31.320 get_feature(0x04) failed 00:31:31.320 ===================================================== 00:31:31.320 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:31:31.320 ===================================================== 00:31:31.320 Controller Capabilities/Features 00:31:31.320 ================================ 00:31:31.320 Vendor ID: 0000 00:31:31.320 Subsystem Vendor ID: 0000 00:31:31.320 Serial Number: 01c1e7e6c330476ff531 00:31:31.320 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:31:31.320 Firmware Version: 6.7.0-68 00:31:31.320 Recommended Arb Burst: 6 00:31:31.320 IEEE OUI Identifier: 00 00 00 00:31:31.320 Multi-path I/O 00:31:31.320 May have multiple subsystem ports: Yes 00:31:31.320 May have multiple controllers: Yes 00:31:31.320 Associated with SR-IOV VF: No 00:31:31.320 Max Data Transfer Size: 1048576 00:31:31.320 Max Number of Namespaces: 1024 00:31:31.320 Max Number of I/O Queues: 128 00:31:31.320 NVMe Specification Version (VS): 1.3 00:31:31.320 NVMe Specification Version (Identify): 1.3 00:31:31.320 Maximum Queue Entries: 128 00:31:31.320 Contiguous Queues Required: No 00:31:31.320 Arbitration Mechanisms Supported 00:31:31.320 Weighted Round Robin: Not Supported 00:31:31.320 Vendor Specific: Not Supported 00:31:31.320 Reset Timeout: 7500 ms 00:31:31.320 Doorbell Stride: 4 bytes 00:31:31.320 NVM Subsystem Reset: Not Supported 00:31:31.320 Command Sets Supported 00:31:31.320 NVM Command Set: Supported 00:31:31.320 Boot Partition: Not Supported 00:31:31.320 Memory Page Size Minimum: 4096 bytes 00:31:31.320 Memory Page Size Maximum: 4096 bytes 00:31:31.320 Persistent Memory Region: Not Supported 00:31:31.320 Optional Asynchronous Events Supported 00:31:31.320 Namespace Attribute Notices: Supported 00:31:31.320 Firmware Activation Notices: Not Supported 00:31:31.320 ANA Change Notices: Supported 00:31:31.320 PLE Aggregate Log Change Notices: Not Supported 00:31:31.320 LBA Status Info Alert Notices: Not Supported 00:31:31.320 EGE Aggregate Log Change Notices: Not Supported 00:31:31.320 Normal NVM Subsystem Shutdown event: Not Supported 00:31:31.320 Zone Descriptor Change Notices: Not Supported 00:31:31.320 Discovery Log Change Notices: Not Supported 00:31:31.320 Controller Attributes 00:31:31.320 128-bit Host Identifier: Supported 00:31:31.320 Non-Operational Permissive Mode: Not Supported 00:31:31.320 NVM Sets: Not Supported 00:31:31.320 Read Recovery Levels: Not Supported 00:31:31.320 Endurance Groups: Not Supported 00:31:31.320 Predictable Latency Mode: Not Supported 00:31:31.320 Traffic Based Keep ALive: Supported 00:31:31.320 Namespace Granularity: Not Supported 00:31:31.320 SQ Associations: Not Supported 00:31:31.320 UUID List: Not Supported 00:31:31.320 Multi-Domain Subsystem: Not Supported 00:31:31.320 Fixed Capacity Management: Not Supported 00:31:31.320 Variable Capacity Management: Not Supported 00:31:31.320 Delete Endurance Group: Not Supported 00:31:31.320 Delete NVM Set: Not Supported 00:31:31.320 Extended LBA Formats Supported: Not Supported 00:31:31.320 Flexible Data Placement Supported: Not Supported 00:31:31.320 00:31:31.320 Controller Memory Buffer Support 00:31:31.320 ================================ 00:31:31.320 Supported: No 00:31:31.320 00:31:31.320 Persistent Memory Region Support 00:31:31.320 ================================ 00:31:31.320 Supported: No 00:31:31.320 00:31:31.320 Admin Command Set Attributes 00:31:31.320 ============================ 00:31:31.320 Security Send/Receive: Not Supported 00:31:31.320 Format NVM: Not Supported 00:31:31.320 Firmware Activate/Download: Not Supported 00:31:31.320 Namespace Management: Not Supported 00:31:31.320 Device Self-Test: Not Supported 00:31:31.320 Directives: Not Supported 00:31:31.320 NVMe-MI: Not Supported 00:31:31.320 Virtualization Management: Not Supported 00:31:31.320 Doorbell Buffer Config: Not Supported 00:31:31.320 Get LBA Status Capability: Not Supported 00:31:31.320 Command & Feature Lockdown Capability: Not Supported 00:31:31.320 Abort Command Limit: 4 00:31:31.320 Async Event Request Limit: 4 00:31:31.320 Number of Firmware Slots: N/A 00:31:31.320 Firmware Slot 1 Read-Only: N/A 00:31:31.320 Firmware Activation Without Reset: N/A 00:31:31.320 Multiple Update Detection Support: N/A 00:31:31.320 Firmware Update Granularity: No Information Provided 00:31:31.320 Per-Namespace SMART Log: Yes 00:31:31.320 Asymmetric Namespace Access Log Page: Supported 00:31:31.320 ANA Transition Time : 10 sec 00:31:31.320 00:31:31.320 Asymmetric Namespace Access Capabilities 00:31:31.320 ANA Optimized State : Supported 00:31:31.320 ANA Non-Optimized State : Supported 00:31:31.320 ANA Inaccessible State : Supported 00:31:31.320 ANA Persistent Loss State : Supported 00:31:31.320 ANA Change State : Supported 00:31:31.320 ANAGRPID is not changed : No 00:31:31.320 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:31:31.320 00:31:31.320 ANA Group Identifier Maximum : 128 00:31:31.320 Number of ANA Group Identifiers : 128 00:31:31.320 Max Number of Allowed Namespaces : 1024 00:31:31.320 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:31:31.320 Command Effects Log Page: Supported 00:31:31.320 Get Log Page Extended Data: Supported 00:31:31.320 Telemetry Log Pages: Not Supported 00:31:31.320 Persistent Event Log Pages: Not Supported 00:31:31.320 Supported Log Pages Log Page: May Support 00:31:31.320 Commands Supported & Effects Log Page: Not Supported 00:31:31.320 Feature Identifiers & Effects Log Page:May Support 00:31:31.320 NVMe-MI Commands & Effects Log Page: May Support 00:31:31.320 Data Area 4 for Telemetry Log: Not Supported 00:31:31.320 Error Log Page Entries Supported: 128 00:31:31.320 Keep Alive: Supported 00:31:31.320 Keep Alive Granularity: 1000 ms 00:31:31.320 00:31:31.320 NVM Command Set Attributes 00:31:31.320 ========================== 00:31:31.320 Submission Queue Entry Size 00:31:31.320 Max: 64 00:31:31.320 Min: 64 00:31:31.320 Completion Queue Entry Size 00:31:31.320 Max: 16 00:31:31.320 Min: 16 00:31:31.320 Number of Namespaces: 1024 00:31:31.320 Compare Command: Not Supported 00:31:31.320 Write Uncorrectable Command: Not Supported 00:31:31.320 Dataset Management Command: Supported 00:31:31.320 Write Zeroes Command: Supported 00:31:31.320 Set Features Save Field: Not Supported 00:31:31.320 Reservations: Not Supported 00:31:31.320 Timestamp: Not Supported 00:31:31.321 Copy: Not Supported 00:31:31.321 Volatile Write Cache: Present 00:31:31.321 Atomic Write Unit (Normal): 1 00:31:31.321 Atomic Write Unit (PFail): 1 00:31:31.321 Atomic Compare & Write Unit: 1 00:31:31.321 Fused Compare & Write: Not Supported 00:31:31.321 Scatter-Gather List 00:31:31.321 SGL Command Set: Supported 00:31:31.321 SGL Keyed: Supported 00:31:31.321 SGL Bit Bucket Descriptor: Not Supported 00:31:31.321 SGL Metadata Pointer: Not Supported 00:31:31.321 Oversized SGL: Not Supported 00:31:31.321 SGL Metadata Address: Not Supported 00:31:31.321 SGL Offset: Supported 00:31:31.321 Transport SGL Data Block: Not Supported 00:31:31.321 Replay Protected Memory Block: Not Supported 00:31:31.321 00:31:31.321 Firmware Slot Information 00:31:31.321 ========================= 00:31:31.321 Active slot: 0 00:31:31.321 00:31:31.321 Asymmetric Namespace Access 00:31:31.321 =========================== 00:31:31.321 Change Count : 0 00:31:31.321 Number of ANA Group Descriptors : 1 00:31:31.321 ANA Group Descriptor : 0 00:31:31.321 ANA Group ID : 1 00:31:31.321 Number of NSID Values : 1 00:31:31.321 Change Count : 0 00:31:31.321 ANA State : 1 00:31:31.321 Namespace Identifier : 1 00:31:31.321 00:31:31.321 Commands Supported and Effects 00:31:31.321 ============================== 00:31:31.321 Admin Commands 00:31:31.321 -------------- 00:31:31.321 Get Log Page (02h): Supported 00:31:31.321 Identify (06h): Supported 00:31:31.321 Abort (08h): Supported 00:31:31.321 Set Features (09h): Supported 00:31:31.321 Get Features (0Ah): Supported 00:31:31.321 Asynchronous Event Request (0Ch): Supported 00:31:31.321 Keep Alive (18h): Supported 00:31:31.321 I/O Commands 00:31:31.321 ------------ 00:31:31.321 Flush (00h): Supported 00:31:31.321 Write (01h): Supported LBA-Change 00:31:31.321 Read (02h): Supported 00:31:31.321 Write Zeroes (08h): Supported LBA-Change 00:31:31.321 Dataset Management (09h): Supported 00:31:31.321 00:31:31.321 Error Log 00:31:31.321 ========= 00:31:31.321 Entry: 0 00:31:31.321 Error Count: 0x3 00:31:31.321 Submission Queue Id: 0x0 00:31:31.321 Command Id: 0x5 00:31:31.321 Phase Bit: 0 00:31:31.321 Status Code: 0x2 00:31:31.321 Status Code Type: 0x0 00:31:31.321 Do Not Retry: 1 00:31:31.321 Error Location: 0x28 00:31:31.321 LBA: 0x0 00:31:31.321 Namespace: 0x0 00:31:31.321 Vendor Log Page: 0x0 00:31:31.321 ----------- 00:31:31.321 Entry: 1 00:31:31.321 Error Count: 0x2 00:31:31.321 Submission Queue Id: 0x0 00:31:31.321 Command Id: 0x5 00:31:31.321 Phase Bit: 0 00:31:31.321 Status Code: 0x2 00:31:31.321 Status Code Type: 0x0 00:31:31.321 Do Not Retry: 1 00:31:31.321 Error Location: 0x28 00:31:31.321 LBA: 0x0 00:31:31.321 Namespace: 0x0 00:31:31.321 Vendor Log Page: 0x0 00:31:31.321 ----------- 00:31:31.321 Entry: 2 00:31:31.321 Error Count: 0x1 00:31:31.321 Submission Queue Id: 0x0 00:31:31.321 Command Id: 0x0 00:31:31.321 Phase Bit: 0 00:31:31.321 Status Code: 0x2 00:31:31.321 Status Code Type: 0x0 00:31:31.321 Do Not Retry: 1 00:31:31.321 Error Location: 0x28 00:31:31.321 LBA: 0x0 00:31:31.321 Namespace: 0x0 00:31:31.321 Vendor Log Page: 0x0 00:31:31.321 00:31:31.321 Number of Queues 00:31:31.321 ================ 00:31:31.321 Number of I/O Submission Queues: 128 00:31:31.321 Number of I/O Completion Queues: 128 00:31:31.321 00:31:31.321 ZNS Specific Controller Data 00:31:31.321 ============================ 00:31:31.321 Zone Append Size Limit: 0 00:31:31.321 00:31:31.321 00:31:31.321 Active Namespaces 00:31:31.321 ================= 00:31:31.321 get_feature(0x05) failed 00:31:31.321 Namespace ID:1 00:31:31.321 Command Set Identifier: NVM (00h) 00:31:31.321 Deallocate: Supported 00:31:31.321 Deallocated/Unwritten Error: Not Supported 00:31:31.321 Deallocated Read Value: Unknown 00:31:31.321 Deallocate in Write Zeroes: Not Supported 00:31:31.321 Deallocated Guard Field: 0xFFFF 00:31:31.321 Flush: Supported 00:31:31.321 Reservation: Not Supported 00:31:31.321 Namespace Sharing Capabilities: Multiple Controllers 00:31:31.321 Size (in LBAs): 7814037168 (3726GiB) 00:31:31.321 Capacity (in LBAs): 7814037168 (3726GiB) 00:31:31.321 Utilization (in LBAs): 7814037168 (3726GiB) 00:31:31.321 UUID: 2b029df1-ef0e-49f7-ae66-df2a984483bf 00:31:31.321 Thin Provisioning: Not Supported 00:31:31.321 Per-NS Atomic Units: Yes 00:31:31.321 Atomic Boundary Size (Normal): 0 00:31:31.321 Atomic Boundary Size (PFail): 0 00:31:31.321 Atomic Boundary Offset: 0 00:31:31.321 NGUID/EUI64 Never Reused: No 00:31:31.321 ANA group ID: 1 00:31:31.321 Namespace Write Protected: No 00:31:31.321 Number of LBA Formats: 1 00:31:31.321 Current LBA Format: LBA Format #00 00:31:31.321 LBA Format #00: Data Size: 512 Metadata Size: 0 00:31:31.321 00:31:31.580 21:32:25 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:31:31.580 21:32:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:31.580 21:32:25 -- nvmf/common.sh@117 -- # sync 00:31:31.580 21:32:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:31.580 21:32:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:31.580 21:32:25 -- nvmf/common.sh@120 -- # set +e 00:31:31.580 21:32:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:31.580 21:32:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:31.580 rmmod nvme_rdma 00:31:31.580 rmmod nvme_fabrics 00:31:31.580 21:32:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:31.580 21:32:25 -- nvmf/common.sh@124 -- # set -e 00:31:31.580 21:32:25 -- nvmf/common.sh@125 -- # return 0 00:31:31.580 21:32:25 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:31:31.580 21:32:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:31.580 21:32:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:31.580 21:32:25 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:31:31.580 21:32:25 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:31:31.580 21:32:25 -- nvmf/common.sh@675 -- # echo 0 00:31:31.580 21:32:25 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:31.580 21:32:25 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:31.580 21:32:25 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:31:31.580 21:32:25 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:31.580 21:32:25 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:31:31.580 21:32:25 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:31:31.580 21:32:25 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:31:34.117 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:34.117 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:37.463 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:31:38.842 00:31:38.842 real 0m17.426s 00:31:38.842 user 0m4.004s 00:31:38.842 sys 0m8.763s 00:31:38.842 21:32:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:38.842 21:32:32 -- common/autotest_common.sh@10 -- # set +x 00:31:38.842 ************************************ 00:31:38.842 END TEST nvmf_identify_kernel_target 00:31:38.842 ************************************ 00:31:38.842 21:32:32 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:38.842 21:32:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:38.842 21:32:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:38.842 21:32:32 -- common/autotest_common.sh@10 -- # set +x 00:31:38.842 ************************************ 00:31:38.842 START TEST nvmf_auth 00:31:38.842 ************************************ 00:31:38.842 21:32:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:38.842 * Looking for test storage... 00:31:38.842 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:38.842 21:32:33 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:38.842 21:32:33 -- nvmf/common.sh@7 -- # uname -s 00:31:38.842 21:32:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:38.842 21:32:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:38.842 21:32:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:38.842 21:32:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:38.842 21:32:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:38.842 21:32:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:38.842 21:32:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:38.842 21:32:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:38.842 21:32:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:38.842 21:32:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:38.842 21:32:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:38.842 21:32:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:38.842 21:32:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:38.842 21:32:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:38.842 21:32:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:38.842 21:32:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:38.842 21:32:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:38.842 21:32:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:38.842 21:32:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:38.842 21:32:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:38.842 21:32:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:38.842 21:32:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:38.842 21:32:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:38.842 21:32:33 -- paths/export.sh@5 -- # export PATH 00:31:38.842 21:32:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:38.842 21:32:33 -- nvmf/common.sh@47 -- # : 0 00:31:38.842 21:32:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:38.842 21:32:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:38.842 21:32:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:38.842 21:32:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:38.842 21:32:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:38.842 21:32:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:38.842 21:32:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:38.842 21:32:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:38.842 21:32:33 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:31:38.842 21:32:33 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:31:38.842 21:32:33 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:31:38.842 21:32:33 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:31:38.842 21:32:33 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:31:38.842 21:32:33 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:31:38.842 21:32:33 -- host/auth.sh@21 -- # keys=() 00:31:38.842 21:32:33 -- host/auth.sh@77 -- # nvmftestinit 00:31:38.842 21:32:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:38.842 21:32:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:38.842 21:32:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:38.842 21:32:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:38.842 21:32:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:38.842 21:32:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:38.842 21:32:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:38.842 21:32:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:38.842 21:32:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:38.842 21:32:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:38.842 21:32:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:38.842 21:32:33 -- common/autotest_common.sh@10 -- # set +x 00:31:44.129 21:32:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:44.129 21:32:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:44.129 21:32:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:44.129 21:32:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:44.129 21:32:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:44.129 21:32:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:44.129 21:32:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:44.129 21:32:38 -- nvmf/common.sh@295 -- # net_devs=() 00:31:44.129 21:32:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:44.129 21:32:38 -- nvmf/common.sh@296 -- # e810=() 00:31:44.129 21:32:38 -- nvmf/common.sh@296 -- # local -ga e810 00:31:44.129 21:32:38 -- nvmf/common.sh@297 -- # x722=() 00:31:44.129 21:32:38 -- nvmf/common.sh@297 -- # local -ga x722 00:31:44.129 21:32:38 -- nvmf/common.sh@298 -- # mlx=() 00:31:44.129 21:32:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:44.129 21:32:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:44.129 21:32:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:44.129 21:32:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:44.129 21:32:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:44.129 21:32:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:31:44.129 21:32:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:44.129 21:32:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:44.129 21:32:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:31:44.129 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:31:44.129 21:32:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:44.129 21:32:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:44.129 21:32:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:44.129 21:32:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:31:44.129 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:31:44.130 21:32:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:44.130 21:32:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:44.130 21:32:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:44.130 21:32:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:44.130 21:32:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:44.130 21:32:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:31:44.130 Found net devices under 0000:18:00.0: mlx_0_0 00:31:44.130 21:32:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:44.130 21:32:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:44.130 21:32:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:44.130 21:32:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:44.130 21:32:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:31:44.130 Found net devices under 0000:18:00.1: mlx_0_1 00:31:44.130 21:32:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:44.130 21:32:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:44.130 21:32:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:44.130 21:32:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:44.130 21:32:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:44.130 21:32:38 -- nvmf/common.sh@58 -- # uname 00:31:44.130 21:32:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:44.130 21:32:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:44.130 21:32:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:44.130 21:32:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:44.130 21:32:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:44.130 21:32:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:44.130 21:32:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:44.130 21:32:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:44.130 21:32:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:44.130 21:32:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:44.130 21:32:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:44.130 21:32:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:44.130 21:32:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:44.130 21:32:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:44.130 21:32:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:44.130 21:32:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:44.130 21:32:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:44.130 21:32:38 -- nvmf/common.sh@105 -- # continue 2 00:31:44.130 21:32:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.130 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:44.130 21:32:38 -- nvmf/common.sh@105 -- # continue 2 00:31:44.130 21:32:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:44.130 21:32:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:31:44.130 21:32:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.130 21:32:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:44.130 21:32:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:31:44.130 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:44.130 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:31:44.130 altname enp24s0f0np0 00:31:44.130 altname ens785f0np0 00:31:44.130 inet 192.168.100.8/24 scope global mlx_0_0 00:31:44.130 valid_lft forever preferred_lft forever 00:31:44.130 21:32:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:44.130 21:32:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:31:44.130 21:32:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.130 21:32:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.130 21:32:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:44.130 21:32:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:31:44.130 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:44.130 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:31:44.130 altname enp24s0f1np1 00:31:44.130 altname ens785f1np1 00:31:44.130 inet 192.168.100.9/24 scope global mlx_0_1 00:31:44.130 valid_lft forever preferred_lft forever 00:31:44.130 21:32:38 -- nvmf/common.sh@411 -- # return 0 00:31:44.130 21:32:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:44.130 21:32:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:44.130 21:32:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:44.130 21:32:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:44.130 21:32:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:44.130 21:32:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:44.390 21:32:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:44.390 21:32:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:44.390 21:32:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:44.390 21:32:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:44.390 21:32:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.390 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.390 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:44.390 21:32:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:44.390 21:32:38 -- nvmf/common.sh@105 -- # continue 2 00:31:44.390 21:32:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.390 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.390 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:44.390 21:32:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.390 21:32:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:44.390 21:32:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:44.390 21:32:38 -- nvmf/common.sh@105 -- # continue 2 00:31:44.390 21:32:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:44.390 21:32:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:31:44.390 21:32:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.390 21:32:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:44.390 21:32:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:31:44.390 21:32:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.390 21:32:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.390 21:32:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:44.390 192.168.100.9' 00:31:44.390 21:32:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:44.390 192.168.100.9' 00:31:44.390 21:32:38 -- nvmf/common.sh@446 -- # head -n 1 00:31:44.390 21:32:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:44.390 21:32:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:44.390 192.168.100.9' 00:31:44.390 21:32:38 -- nvmf/common.sh@447 -- # tail -n +2 00:31:44.390 21:32:38 -- nvmf/common.sh@447 -- # head -n 1 00:31:44.390 21:32:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:44.390 21:32:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:44.390 21:32:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:44.390 21:32:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:44.390 21:32:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:44.390 21:32:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:44.390 21:32:38 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:31:44.390 21:32:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:31:44.390 21:32:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:31:44.390 21:32:38 -- common/autotest_common.sh@10 -- # set +x 00:31:44.390 21:32:38 -- nvmf/common.sh@470 -- # nvmfpid=1554060 00:31:44.390 21:32:38 -- nvmf/common.sh@471 -- # waitforlisten 1554060 00:31:44.390 21:32:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:31:44.390 21:32:38 -- common/autotest_common.sh@817 -- # '[' -z 1554060 ']' 00:31:44.390 21:32:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:44.390 21:32:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:44.390 21:32:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:44.390 21:32:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:44.390 21:32:38 -- common/autotest_common.sh@10 -- # set +x 00:31:45.329 21:32:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:45.329 21:32:39 -- common/autotest_common.sh@850 -- # return 0 00:31:45.329 21:32:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:31:45.329 21:32:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:45.329 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.329 21:32:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:45.329 21:32:39 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:31:45.329 21:32:39 -- host/auth.sh@81 -- # gen_key null 32 00:31:45.329 21:32:39 -- host/auth.sh@53 -- # local digest len file key 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # local -A digests 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # digest=null 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # len=32 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # key=19f977796c998e32ffcb4927a62ac6ec 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.b4c 00:31:45.329 21:32:39 -- host/auth.sh@59 -- # format_dhchap_key 19f977796c998e32ffcb4927a62ac6ec 0 00:31:45.329 21:32:39 -- nvmf/common.sh@708 -- # format_key DHHC-1 19f977796c998e32ffcb4927a62ac6ec 0 00:31:45.329 21:32:39 -- nvmf/common.sh@691 -- # local prefix key digest 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # key=19f977796c998e32ffcb4927a62ac6ec 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # digest=0 00:31:45.329 21:32:39 -- nvmf/common.sh@694 -- # python - 00:31:45.329 21:32:39 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.b4c 00:31:45.329 21:32:39 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.b4c 00:31:45.329 21:32:39 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.b4c 00:31:45.329 21:32:39 -- host/auth.sh@82 -- # gen_key null 48 00:31:45.329 21:32:39 -- host/auth.sh@53 -- # local digest len file key 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # local -A digests 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # digest=null 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # len=48 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # key=4d90e7b8b671d2d041d5d2a0888607d82723542ff88e9dac 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.poc 00:31:45.329 21:32:39 -- host/auth.sh@59 -- # format_dhchap_key 4d90e7b8b671d2d041d5d2a0888607d82723542ff88e9dac 0 00:31:45.329 21:32:39 -- nvmf/common.sh@708 -- # format_key DHHC-1 4d90e7b8b671d2d041d5d2a0888607d82723542ff88e9dac 0 00:31:45.329 21:32:39 -- nvmf/common.sh@691 -- # local prefix key digest 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # key=4d90e7b8b671d2d041d5d2a0888607d82723542ff88e9dac 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # digest=0 00:31:45.329 21:32:39 -- nvmf/common.sh@694 -- # python - 00:31:45.329 21:32:39 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.poc 00:31:45.329 21:32:39 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.poc 00:31:45.329 21:32:39 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.poc 00:31:45.329 21:32:39 -- host/auth.sh@83 -- # gen_key sha256 32 00:31:45.329 21:32:39 -- host/auth.sh@53 -- # local digest len file key 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # local -A digests 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # digest=sha256 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # len=32 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # key=074dd49b69c94567e6703c825f566909 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.ORB 00:31:45.329 21:32:39 -- host/auth.sh@59 -- # format_dhchap_key 074dd49b69c94567e6703c825f566909 1 00:31:45.329 21:32:39 -- nvmf/common.sh@708 -- # format_key DHHC-1 074dd49b69c94567e6703c825f566909 1 00:31:45.329 21:32:39 -- nvmf/common.sh@691 -- # local prefix key digest 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # key=074dd49b69c94567e6703c825f566909 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # digest=1 00:31:45.329 21:32:39 -- nvmf/common.sh@694 -- # python - 00:31:45.329 21:32:39 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.ORB 00:31:45.329 21:32:39 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.ORB 00:31:45.329 21:32:39 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.ORB 00:31:45.329 21:32:39 -- host/auth.sh@84 -- # gen_key sha384 48 00:31:45.329 21:32:39 -- host/auth.sh@53 -- # local digest len file key 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # local -A digests 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # digest=sha384 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # len=48 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # key=01919a22c4b46f3837a85b2104b9843294fb769384d26282 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.t7b 00:31:45.329 21:32:39 -- host/auth.sh@59 -- # format_dhchap_key 01919a22c4b46f3837a85b2104b9843294fb769384d26282 2 00:31:45.329 21:32:39 -- nvmf/common.sh@708 -- # format_key DHHC-1 01919a22c4b46f3837a85b2104b9843294fb769384d26282 2 00:31:45.329 21:32:39 -- nvmf/common.sh@691 -- # local prefix key digest 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # key=01919a22c4b46f3837a85b2104b9843294fb769384d26282 00:31:45.329 21:32:39 -- nvmf/common.sh@693 -- # digest=2 00:31:45.329 21:32:39 -- nvmf/common.sh@694 -- # python - 00:31:45.329 21:32:39 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.t7b 00:31:45.329 21:32:39 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.t7b 00:31:45.329 21:32:39 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.t7b 00:31:45.329 21:32:39 -- host/auth.sh@85 -- # gen_key sha512 64 00:31:45.329 21:32:39 -- host/auth.sh@53 -- # local digest len file key 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:31:45.329 21:32:39 -- host/auth.sh@54 -- # local -A digests 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # digest=sha512 00:31:45.329 21:32:39 -- host/auth.sh@56 -- # len=64 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:31:45.329 21:32:39 -- host/auth.sh@57 -- # key=005a9ef332ba996eefb4393295b9c554b44bb06a947d4ba46e04a4c6cfe2378a 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:31:45.329 21:32:39 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.G9e 00:31:45.329 21:32:39 -- host/auth.sh@59 -- # format_dhchap_key 005a9ef332ba996eefb4393295b9c554b44bb06a947d4ba46e04a4c6cfe2378a 3 00:31:45.329 21:32:39 -- nvmf/common.sh@708 -- # format_key DHHC-1 005a9ef332ba996eefb4393295b9c554b44bb06a947d4ba46e04a4c6cfe2378a 3 00:31:45.330 21:32:39 -- nvmf/common.sh@691 -- # local prefix key digest 00:31:45.330 21:32:39 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:31:45.330 21:32:39 -- nvmf/common.sh@693 -- # key=005a9ef332ba996eefb4393295b9c554b44bb06a947d4ba46e04a4c6cfe2378a 00:31:45.330 21:32:39 -- nvmf/common.sh@693 -- # digest=3 00:31:45.330 21:32:39 -- nvmf/common.sh@694 -- # python - 00:31:45.589 21:32:39 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.G9e 00:31:45.589 21:32:39 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.G9e 00:31:45.589 21:32:39 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.G9e 00:31:45.589 21:32:39 -- host/auth.sh@87 -- # waitforlisten 1554060 00:31:45.589 21:32:39 -- common/autotest_common.sh@817 -- # '[' -z 1554060 ']' 00:31:45.589 21:32:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:45.589 21:32:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:45.589 21:32:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:45.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:45.589 21:32:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:45.589 21:32:39 -- common/autotest_common.sh@850 -- # return 0 00:31:45.589 21:32:39 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:31:45.589 21:32:39 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.b4c 00:31:45.589 21:32:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:45.589 21:32:39 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:31:45.589 21:32:39 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.poc 00:31:45.589 21:32:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:45.589 21:32:39 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:31:45.589 21:32:39 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.ORB 00:31:45.589 21:32:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:45.589 21:32:39 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:31:45.589 21:32:39 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.t7b 00:31:45.589 21:32:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:45.589 21:32:39 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:31:45.589 21:32:39 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.G9e 00:31:45.589 21:32:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:45.589 21:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:45.589 21:32:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:45.589 21:32:39 -- host/auth.sh@92 -- # nvmet_auth_init 00:31:45.589 21:32:39 -- host/auth.sh@35 -- # get_main_ns_ip 00:31:45.589 21:32:39 -- nvmf/common.sh@717 -- # local ip 00:31:45.589 21:32:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:45.589 21:32:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:45.589 21:32:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:45.589 21:32:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:45.589 21:32:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:45.589 21:32:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:45.589 21:32:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:45.589 21:32:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:45.589 21:32:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:45.589 21:32:39 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:31:45.589 21:32:39 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:31:45.589 21:32:39 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:31:45.589 21:32:39 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:31:45.589 21:32:39 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:31:45.589 21:32:39 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:31:45.589 21:32:39 -- nvmf/common.sh@628 -- # local block nvme 00:31:45.589 21:32:39 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:31:45.589 21:32:39 -- nvmf/common.sh@631 -- # modprobe nvmet 00:31:45.589 21:32:39 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:31:45.589 21:32:39 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:31:48.125 Waiting for block devices as requested 00:31:48.125 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:48.125 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:48.125 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:48.384 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:48.384 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:48.384 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:48.384 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:48.643 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:48.643 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:48.643 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:48.902 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:48.902 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:48.902 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:48.902 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:49.161 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:49.161 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:49.161 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:31:51.064 21:32:45 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:31:51.064 21:32:45 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:31:51.064 21:32:45 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:31:51.064 21:32:45 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:31:51.064 21:32:45 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:31:51.064 21:32:45 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:31:51.064 21:32:45 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:31:51.064 21:32:45 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:31:51.064 21:32:45 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:31:51.064 No valid GPT data, bailing 00:31:51.064 21:32:45 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:31:51.064 21:32:45 -- scripts/common.sh@391 -- # pt= 00:31:51.064 21:32:45 -- scripts/common.sh@392 -- # return 1 00:31:51.064 21:32:45 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:31:51.064 21:32:45 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:31:51.064 21:32:45 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:31:51.064 21:32:45 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:31:51.064 21:32:45 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:31:51.064 21:32:45 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:31:51.064 21:32:45 -- nvmf/common.sh@656 -- # echo 1 00:31:51.064 21:32:45 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:31:51.064 21:32:45 -- nvmf/common.sh@658 -- # echo 1 00:31:51.064 21:32:45 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:31:51.064 21:32:45 -- nvmf/common.sh@661 -- # echo rdma 00:31:51.064 21:32:45 -- nvmf/common.sh@662 -- # echo 4420 00:31:51.064 21:32:45 -- nvmf/common.sh@663 -- # echo ipv4 00:31:51.064 21:32:45 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:31:51.064 21:32:45 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:31:51.324 00:31:51.324 Discovery Log Number of Records 2, Generation counter 2 00:31:51.324 =====Discovery Log Entry 0====== 00:31:51.324 trtype: rdma 00:31:51.324 adrfam: ipv4 00:31:51.324 subtype: current discovery subsystem 00:31:51.324 treq: not specified, sq flow control disable supported 00:31:51.324 portid: 1 00:31:51.324 trsvcid: 4420 00:31:51.324 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:31:51.324 traddr: 192.168.100.8 00:31:51.324 eflags: none 00:31:51.324 rdma_prtype: not specified 00:31:51.324 rdma_qptype: connected 00:31:51.324 rdma_cms: rdma-cm 00:31:51.324 rdma_pkey: 0x0000 00:31:51.324 =====Discovery Log Entry 1====== 00:31:51.324 trtype: rdma 00:31:51.324 adrfam: ipv4 00:31:51.324 subtype: nvme subsystem 00:31:51.324 treq: not specified, sq flow control disable supported 00:31:51.324 portid: 1 00:31:51.324 trsvcid: 4420 00:31:51.324 subnqn: nqn.2024-02.io.spdk:cnode0 00:31:51.324 traddr: 192.168.100.8 00:31:51.324 eflags: none 00:31:51.324 rdma_prtype: not specified 00:31:51.324 rdma_qptype: connected 00:31:51.324 rdma_cms: rdma-cm 00:31:51.324 rdma_pkey: 0x0000 00:31:51.324 21:32:45 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:31:51.324 21:32:45 -- host/auth.sh@37 -- # echo 0 00:31:51.324 21:32:45 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:31:51.324 21:32:45 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:31:51.324 21:32:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:51.324 21:32:45 -- host/auth.sh@44 -- # digest=sha256 00:31:51.324 21:32:45 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:51.324 21:32:45 -- host/auth.sh@44 -- # keyid=1 00:31:51.324 21:32:45 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:51.324 21:32:45 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:51.324 21:32:45 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:51.324 21:32:45 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:51.324 21:32:45 -- host/auth.sh@100 -- # IFS=, 00:31:51.324 21:32:45 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:31:51.324 21:32:45 -- host/auth.sh@100 -- # IFS=, 00:31:51.324 21:32:45 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:31:51.324 21:32:45 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:31:51.324 21:32:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:51.324 21:32:45 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:31:51.324 21:32:45 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:31:51.324 21:32:45 -- host/auth.sh@68 -- # keyid=1 00:31:51.324 21:32:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:31:51.324 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.324 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.324 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.324 21:32:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:51.324 21:32:45 -- nvmf/common.sh@717 -- # local ip 00:31:51.324 21:32:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:51.324 21:32:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:51.324 21:32:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:51.324 21:32:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:51.324 21:32:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:51.324 21:32:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:51.324 21:32:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:51.324 21:32:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:51.324 21:32:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:51.324 21:32:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:51.324 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.324 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.324 nvme0n1 00:31:51.324 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.324 21:32:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:51.324 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.324 21:32:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:51.324 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.324 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.583 21:32:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:51.583 21:32:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:51.583 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.583 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.583 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.583 21:32:45 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:31:51.583 21:32:45 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:31:51.583 21:32:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:51.583 21:32:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:31:51.583 21:32:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:51.583 21:32:45 -- host/auth.sh@44 -- # digest=sha256 00:31:51.583 21:32:45 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:51.583 21:32:45 -- host/auth.sh@44 -- # keyid=0 00:31:51.583 21:32:45 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:51.583 21:32:45 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:51.583 21:32:45 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:51.583 21:32:45 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:51.583 21:32:45 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:31:51.583 21:32:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:51.583 21:32:45 -- host/auth.sh@68 -- # digest=sha256 00:31:51.583 21:32:45 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:31:51.583 21:32:45 -- host/auth.sh@68 -- # keyid=0 00:31:51.583 21:32:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:31:51.583 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.583 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.583 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.583 21:32:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:51.583 21:32:45 -- nvmf/common.sh@717 -- # local ip 00:31:51.583 21:32:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:51.583 21:32:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:51.583 21:32:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:51.583 21:32:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:51.583 21:32:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:51.583 21:32:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:51.583 21:32:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:51.583 21:32:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:51.583 21:32:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:51.583 21:32:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:31:51.583 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.583 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.583 nvme0n1 00:31:51.583 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.583 21:32:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:51.584 21:32:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:51.584 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.584 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.584 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.584 21:32:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:51.584 21:32:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:51.584 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.584 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.843 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.843 21:32:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:51.843 21:32:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:31:51.843 21:32:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:51.843 21:32:45 -- host/auth.sh@44 -- # digest=sha256 00:31:51.843 21:32:45 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:51.843 21:32:45 -- host/auth.sh@44 -- # keyid=1 00:31:51.843 21:32:45 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:51.843 21:32:45 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:51.843 21:32:45 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:51.843 21:32:45 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:51.843 21:32:45 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:31:51.843 21:32:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:51.843 21:32:45 -- host/auth.sh@68 -- # digest=sha256 00:31:51.843 21:32:45 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:31:51.843 21:32:45 -- host/auth.sh@68 -- # keyid=1 00:31:51.843 21:32:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:31:51.843 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.843 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.843 21:32:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.843 21:32:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:51.843 21:32:45 -- nvmf/common.sh@717 -- # local ip 00:31:51.843 21:32:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:51.843 21:32:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:51.843 21:32:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:51.843 21:32:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:51.843 21:32:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:51.843 21:32:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:51.843 21:32:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:51.843 21:32:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:51.843 21:32:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:51.843 21:32:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:51.843 21:32:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.843 21:32:45 -- common/autotest_common.sh@10 -- # set +x 00:31:51.843 nvme0n1 00:31:51.843 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.843 21:32:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:51.843 21:32:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:51.843 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.843 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:51.843 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:51.843 21:32:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:51.843 21:32:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:51.843 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:51.843 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.103 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.103 21:32:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:52.103 21:32:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:31:52.103 21:32:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:52.103 21:32:46 -- host/auth.sh@44 -- # digest=sha256 00:31:52.103 21:32:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:52.103 21:32:46 -- host/auth.sh@44 -- # keyid=2 00:31:52.103 21:32:46 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:52.103 21:32:46 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:52.103 21:32:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:52.103 21:32:46 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:52.103 21:32:46 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:31:52.103 21:32:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:52.103 21:32:46 -- host/auth.sh@68 -- # digest=sha256 00:31:52.103 21:32:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:31:52.103 21:32:46 -- host/auth.sh@68 -- # keyid=2 00:31:52.103 21:32:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:31:52.103 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.103 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.103 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.103 21:32:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:52.103 21:32:46 -- nvmf/common.sh@717 -- # local ip 00:31:52.103 21:32:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:52.103 21:32:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:52.103 21:32:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:52.103 21:32:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:52.103 21:32:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:52.103 21:32:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:52.103 21:32:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:52.103 21:32:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:52.103 21:32:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:52.103 21:32:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:31:52.103 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.103 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.103 nvme0n1 00:31:52.103 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.103 21:32:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:52.103 21:32:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:52.103 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.103 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.103 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.103 21:32:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:52.103 21:32:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:52.103 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.103 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.363 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.363 21:32:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:52.363 21:32:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:31:52.363 21:32:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:52.363 21:32:46 -- host/auth.sh@44 -- # digest=sha256 00:31:52.363 21:32:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:52.363 21:32:46 -- host/auth.sh@44 -- # keyid=3 00:31:52.363 21:32:46 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:52.363 21:32:46 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:52.363 21:32:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:52.363 21:32:46 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:52.363 21:32:46 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:31:52.363 21:32:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:52.363 21:32:46 -- host/auth.sh@68 -- # digest=sha256 00:31:52.363 21:32:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:31:52.363 21:32:46 -- host/auth.sh@68 -- # keyid=3 00:31:52.363 21:32:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:31:52.363 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.363 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.363 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.363 21:32:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:52.363 21:32:46 -- nvmf/common.sh@717 -- # local ip 00:31:52.363 21:32:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:52.363 21:32:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:52.363 21:32:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:52.363 21:32:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:52.363 21:32:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:52.363 21:32:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:52.363 21:32:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:52.363 21:32:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:52.363 21:32:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:52.363 21:32:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:31:52.363 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.363 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.363 nvme0n1 00:31:52.363 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.363 21:32:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:52.363 21:32:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:52.363 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.363 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.363 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.363 21:32:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:52.363 21:32:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:52.363 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.363 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.622 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.622 21:32:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:52.622 21:32:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:31:52.622 21:32:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:52.622 21:32:46 -- host/auth.sh@44 -- # digest=sha256 00:31:52.622 21:32:46 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:31:52.622 21:32:46 -- host/auth.sh@44 -- # keyid=4 00:31:52.622 21:32:46 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:52.622 21:32:46 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:52.622 21:32:46 -- host/auth.sh@48 -- # echo ffdhe2048 00:31:52.622 21:32:46 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:52.623 21:32:46 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:31:52.623 21:32:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # digest=sha256 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # keyid=4 00:31:52.623 21:32:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:31:52.623 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.623 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.623 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.623 21:32:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:52.623 21:32:46 -- nvmf/common.sh@717 -- # local ip 00:31:52.623 21:32:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:52.623 21:32:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:52.623 21:32:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:52.623 21:32:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:52.623 21:32:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:52.623 21:32:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:52.623 21:32:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:52.623 21:32:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:52.623 21:32:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:52.623 21:32:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:31:52.623 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.623 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.623 nvme0n1 00:31:52.623 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.623 21:32:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:52.623 21:32:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:52.623 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.623 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.623 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.623 21:32:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:52.623 21:32:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:52.623 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.623 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.623 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.623 21:32:46 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:31:52.623 21:32:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:52.623 21:32:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:31:52.623 21:32:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:52.623 21:32:46 -- host/auth.sh@44 -- # digest=sha256 00:31:52.623 21:32:46 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:31:52.623 21:32:46 -- host/auth.sh@44 -- # keyid=0 00:31:52.623 21:32:46 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:52.623 21:32:46 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:52.623 21:32:46 -- host/auth.sh@48 -- # echo ffdhe3072 00:31:52.623 21:32:46 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:52.623 21:32:46 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:31:52.623 21:32:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # digest=sha256 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:31:52.623 21:32:46 -- host/auth.sh@68 -- # keyid=0 00:31:52.623 21:32:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:31:52.623 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.623 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.882 21:32:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.882 21:32:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:52.882 21:32:46 -- nvmf/common.sh@717 -- # local ip 00:31:52.882 21:32:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:52.882 21:32:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:52.882 21:32:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:52.882 21:32:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:52.882 21:32:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:52.882 21:32:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:52.882 21:32:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:52.882 21:32:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:52.882 21:32:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:52.882 21:32:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:31:52.882 21:32:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.882 21:32:46 -- common/autotest_common.sh@10 -- # set +x 00:31:52.882 nvme0n1 00:31:52.882 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.882 21:32:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:52.882 21:32:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:52.882 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.882 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:52.882 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:52.882 21:32:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:52.882 21:32:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:52.882 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:52.882 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.141 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.141 21:32:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:53.141 21:32:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:31:53.141 21:32:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:53.141 21:32:47 -- host/auth.sh@44 -- # digest=sha256 00:31:53.141 21:32:47 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:31:53.141 21:32:47 -- host/auth.sh@44 -- # keyid=1 00:31:53.141 21:32:47 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:53.141 21:32:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:53.141 21:32:47 -- host/auth.sh@48 -- # echo ffdhe3072 00:31:53.141 21:32:47 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:53.141 21:32:47 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:31:53.141 21:32:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:53.141 21:32:47 -- host/auth.sh@68 -- # digest=sha256 00:31:53.141 21:32:47 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:31:53.141 21:32:47 -- host/auth.sh@68 -- # keyid=1 00:31:53.141 21:32:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:31:53.141 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.141 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.141 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.141 21:32:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:53.141 21:32:47 -- nvmf/common.sh@717 -- # local ip 00:31:53.141 21:32:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:53.141 21:32:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:53.141 21:32:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:53.141 21:32:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:53.141 21:32:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:53.141 21:32:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:53.141 21:32:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:53.141 21:32:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:53.141 21:32:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:53.141 21:32:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:53.141 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.141 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.141 nvme0n1 00:31:53.141 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.141 21:32:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:53.141 21:32:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:53.141 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.141 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.141 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.141 21:32:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:53.141 21:32:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:53.141 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.141 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.401 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.401 21:32:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:53.401 21:32:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:31:53.401 21:32:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:53.401 21:32:47 -- host/auth.sh@44 -- # digest=sha256 00:31:53.401 21:32:47 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:31:53.401 21:32:47 -- host/auth.sh@44 -- # keyid=2 00:31:53.401 21:32:47 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:53.401 21:32:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:53.401 21:32:47 -- host/auth.sh@48 -- # echo ffdhe3072 00:31:53.401 21:32:47 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:53.401 21:32:47 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:31:53.401 21:32:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:53.401 21:32:47 -- host/auth.sh@68 -- # digest=sha256 00:31:53.401 21:32:47 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:31:53.401 21:32:47 -- host/auth.sh@68 -- # keyid=2 00:31:53.401 21:32:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:31:53.401 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.401 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.401 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.401 21:32:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:53.401 21:32:47 -- nvmf/common.sh@717 -- # local ip 00:31:53.401 21:32:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:53.401 21:32:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:53.401 21:32:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:53.401 21:32:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:53.401 21:32:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:53.401 21:32:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:53.401 21:32:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:53.401 21:32:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:53.401 21:32:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:53.401 21:32:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:31:53.401 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.401 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.401 nvme0n1 00:31:53.401 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.401 21:32:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:53.401 21:32:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:53.401 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.401 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.401 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.660 21:32:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:53.660 21:32:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:53.660 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.660 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.660 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.660 21:32:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:53.660 21:32:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:31:53.660 21:32:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:53.660 21:32:47 -- host/auth.sh@44 -- # digest=sha256 00:31:53.660 21:32:47 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:31:53.660 21:32:47 -- host/auth.sh@44 -- # keyid=3 00:31:53.660 21:32:47 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:53.660 21:32:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:53.660 21:32:47 -- host/auth.sh@48 -- # echo ffdhe3072 00:31:53.660 21:32:47 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:53.660 21:32:47 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:31:53.660 21:32:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:53.660 21:32:47 -- host/auth.sh@68 -- # digest=sha256 00:31:53.660 21:32:47 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:31:53.660 21:32:47 -- host/auth.sh@68 -- # keyid=3 00:31:53.660 21:32:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:31:53.660 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.660 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.660 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.660 21:32:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:53.660 21:32:47 -- nvmf/common.sh@717 -- # local ip 00:31:53.660 21:32:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:53.660 21:32:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:53.660 21:32:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:53.660 21:32:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:53.660 21:32:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:53.660 21:32:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:53.660 21:32:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:53.660 21:32:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:53.660 21:32:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:53.660 21:32:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:31:53.660 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.660 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.660 nvme0n1 00:31:53.660 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.660 21:32:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:53.660 21:32:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:53.660 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.660 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.660 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.919 21:32:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:53.919 21:32:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:53.919 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.919 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.919 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.919 21:32:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:53.919 21:32:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:31:53.919 21:32:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:53.919 21:32:47 -- host/auth.sh@44 -- # digest=sha256 00:31:53.919 21:32:47 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:31:53.919 21:32:47 -- host/auth.sh@44 -- # keyid=4 00:31:53.919 21:32:47 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:53.919 21:32:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:53.919 21:32:47 -- host/auth.sh@48 -- # echo ffdhe3072 00:31:53.919 21:32:47 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:53.919 21:32:47 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:31:53.919 21:32:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:53.919 21:32:47 -- host/auth.sh@68 -- # digest=sha256 00:31:53.919 21:32:47 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:31:53.919 21:32:47 -- host/auth.sh@68 -- # keyid=4 00:31:53.919 21:32:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:31:53.919 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.919 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.919 21:32:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.919 21:32:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:53.919 21:32:47 -- nvmf/common.sh@717 -- # local ip 00:31:53.919 21:32:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:53.919 21:32:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:53.919 21:32:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:53.919 21:32:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:53.919 21:32:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:53.919 21:32:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:53.919 21:32:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:53.919 21:32:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:53.919 21:32:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:53.919 21:32:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:31:53.919 21:32:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.919 21:32:47 -- common/autotest_common.sh@10 -- # set +x 00:31:53.919 nvme0n1 00:31:53.919 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:53.919 21:32:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:53.919 21:32:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:53.919 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:53.919 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:53.919 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.179 21:32:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:54.179 21:32:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:54.179 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.179 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.179 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.179 21:32:48 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:31:54.179 21:32:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:54.179 21:32:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:31:54.179 21:32:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:54.179 21:32:48 -- host/auth.sh@44 -- # digest=sha256 00:31:54.179 21:32:48 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:31:54.179 21:32:48 -- host/auth.sh@44 -- # keyid=0 00:31:54.179 21:32:48 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:54.179 21:32:48 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:54.179 21:32:48 -- host/auth.sh@48 -- # echo ffdhe4096 00:31:54.179 21:32:48 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:54.179 21:32:48 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:31:54.179 21:32:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:54.179 21:32:48 -- host/auth.sh@68 -- # digest=sha256 00:31:54.179 21:32:48 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:31:54.179 21:32:48 -- host/auth.sh@68 -- # keyid=0 00:31:54.179 21:32:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:31:54.179 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.179 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.179 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.179 21:32:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:54.179 21:32:48 -- nvmf/common.sh@717 -- # local ip 00:31:54.179 21:32:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:54.179 21:32:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:54.179 21:32:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:54.179 21:32:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:54.179 21:32:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:54.179 21:32:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:54.179 21:32:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:54.179 21:32:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:54.179 21:32:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:54.179 21:32:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:31:54.179 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.179 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.438 nvme0n1 00:31:54.438 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.438 21:32:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:54.438 21:32:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:54.438 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.438 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.438 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.438 21:32:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:54.438 21:32:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:54.438 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.438 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.438 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.438 21:32:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:54.438 21:32:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:31:54.438 21:32:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:54.438 21:32:48 -- host/auth.sh@44 -- # digest=sha256 00:31:54.438 21:32:48 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:31:54.438 21:32:48 -- host/auth.sh@44 -- # keyid=1 00:31:54.438 21:32:48 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:54.438 21:32:48 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:54.438 21:32:48 -- host/auth.sh@48 -- # echo ffdhe4096 00:31:54.438 21:32:48 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:54.438 21:32:48 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:31:54.438 21:32:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:54.438 21:32:48 -- host/auth.sh@68 -- # digest=sha256 00:31:54.438 21:32:48 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:31:54.438 21:32:48 -- host/auth.sh@68 -- # keyid=1 00:31:54.438 21:32:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:31:54.438 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.438 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.438 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.438 21:32:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:54.438 21:32:48 -- nvmf/common.sh@717 -- # local ip 00:31:54.438 21:32:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:54.438 21:32:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:54.438 21:32:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:54.438 21:32:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:54.438 21:32:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:54.438 21:32:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:54.438 21:32:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:54.438 21:32:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:54.438 21:32:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:54.438 21:32:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:54.438 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.438 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.697 nvme0n1 00:31:54.697 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.697 21:32:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:54.697 21:32:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:54.697 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.697 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.697 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.697 21:32:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:54.697 21:32:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:54.697 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.697 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.697 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.697 21:32:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:54.697 21:32:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:31:54.697 21:32:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:54.697 21:32:48 -- host/auth.sh@44 -- # digest=sha256 00:31:54.697 21:32:48 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:31:54.697 21:32:48 -- host/auth.sh@44 -- # keyid=2 00:31:54.697 21:32:48 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:54.697 21:32:48 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:54.697 21:32:48 -- host/auth.sh@48 -- # echo ffdhe4096 00:31:54.697 21:32:48 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:54.697 21:32:48 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:31:54.697 21:32:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:54.697 21:32:48 -- host/auth.sh@68 -- # digest=sha256 00:31:54.697 21:32:48 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:31:54.697 21:32:48 -- host/auth.sh@68 -- # keyid=2 00:31:54.697 21:32:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:31:54.697 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.697 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.697 21:32:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.697 21:32:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:54.697 21:32:48 -- nvmf/common.sh@717 -- # local ip 00:31:54.697 21:32:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:54.697 21:32:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:54.697 21:32:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:54.697 21:32:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:54.697 21:32:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:54.697 21:32:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:54.697 21:32:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:54.697 21:32:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:54.697 21:32:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:54.697 21:32:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:31:54.697 21:32:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.697 21:32:48 -- common/autotest_common.sh@10 -- # set +x 00:31:54.955 nvme0n1 00:31:54.955 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.955 21:32:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:54.955 21:32:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:54.955 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.955 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:54.955 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.955 21:32:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:54.955 21:32:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:54.955 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.955 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:54.955 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.955 21:32:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:54.955 21:32:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:31:54.955 21:32:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:54.955 21:32:49 -- host/auth.sh@44 -- # digest=sha256 00:31:54.955 21:32:49 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:31:54.955 21:32:49 -- host/auth.sh@44 -- # keyid=3 00:31:54.955 21:32:49 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:54.955 21:32:49 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:54.955 21:32:49 -- host/auth.sh@48 -- # echo ffdhe4096 00:31:54.955 21:32:49 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:54.955 21:32:49 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:31:54.955 21:32:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:54.955 21:32:49 -- host/auth.sh@68 -- # digest=sha256 00:31:54.955 21:32:49 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:31:54.955 21:32:49 -- host/auth.sh@68 -- # keyid=3 00:31:54.955 21:32:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:31:54.955 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.955 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:54.955 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:54.955 21:32:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:54.955 21:32:49 -- nvmf/common.sh@717 -- # local ip 00:31:54.955 21:32:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:54.955 21:32:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:54.955 21:32:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:54.955 21:32:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:54.955 21:32:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:54.955 21:32:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:54.955 21:32:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:54.955 21:32:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:54.955 21:32:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:54.955 21:32:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:31:54.955 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:54.955 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.214 nvme0n1 00:31:55.214 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.214 21:32:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:55.214 21:32:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:55.214 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.214 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.214 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.472 21:32:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:55.472 21:32:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:55.472 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.472 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.472 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.472 21:32:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:55.472 21:32:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:31:55.472 21:32:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:55.472 21:32:49 -- host/auth.sh@44 -- # digest=sha256 00:31:55.472 21:32:49 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:31:55.472 21:32:49 -- host/auth.sh@44 -- # keyid=4 00:31:55.472 21:32:49 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:55.472 21:32:49 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:55.472 21:32:49 -- host/auth.sh@48 -- # echo ffdhe4096 00:31:55.472 21:32:49 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:55.472 21:32:49 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:31:55.472 21:32:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:55.472 21:32:49 -- host/auth.sh@68 -- # digest=sha256 00:31:55.472 21:32:49 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:31:55.472 21:32:49 -- host/auth.sh@68 -- # keyid=4 00:31:55.472 21:32:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:31:55.472 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.472 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.472 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.472 21:32:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:55.472 21:32:49 -- nvmf/common.sh@717 -- # local ip 00:31:55.472 21:32:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:55.472 21:32:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:55.472 21:32:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:55.472 21:32:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:55.472 21:32:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:55.472 21:32:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:55.472 21:32:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:55.472 21:32:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:55.472 21:32:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:55.472 21:32:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:31:55.472 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.472 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.731 nvme0n1 00:31:55.731 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.731 21:32:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:55.731 21:32:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:55.731 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.731 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.731 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.731 21:32:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:55.731 21:32:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:55.731 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.731 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.731 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.731 21:32:49 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:31:55.731 21:32:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:55.731 21:32:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:31:55.731 21:32:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:55.731 21:32:49 -- host/auth.sh@44 -- # digest=sha256 00:31:55.731 21:32:49 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:31:55.731 21:32:49 -- host/auth.sh@44 -- # keyid=0 00:31:55.731 21:32:49 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:55.731 21:32:49 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:55.731 21:32:49 -- host/auth.sh@48 -- # echo ffdhe6144 00:31:55.731 21:32:49 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:55.731 21:32:49 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:31:55.731 21:32:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:55.731 21:32:49 -- host/auth.sh@68 -- # digest=sha256 00:31:55.731 21:32:49 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:31:55.731 21:32:49 -- host/auth.sh@68 -- # keyid=0 00:31:55.731 21:32:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:31:55.731 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.731 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.731 21:32:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.731 21:32:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:55.731 21:32:49 -- nvmf/common.sh@717 -- # local ip 00:31:55.731 21:32:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:55.731 21:32:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:55.731 21:32:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:55.731 21:32:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:55.731 21:32:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:55.731 21:32:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:55.731 21:32:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:55.731 21:32:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:55.731 21:32:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:55.731 21:32:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:31:55.731 21:32:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.731 21:32:49 -- common/autotest_common.sh@10 -- # set +x 00:31:55.990 nvme0n1 00:31:55.990 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.990 21:32:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:55.990 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.990 21:32:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:55.990 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:55.990 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.990 21:32:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:55.990 21:32:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:55.990 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.990 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:55.990 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:55.990 21:32:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:55.990 21:32:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:31:55.990 21:32:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:55.990 21:32:50 -- host/auth.sh@44 -- # digest=sha256 00:31:55.990 21:32:50 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:31:55.990 21:32:50 -- host/auth.sh@44 -- # keyid=1 00:31:55.990 21:32:50 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:55.990 21:32:50 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:55.990 21:32:50 -- host/auth.sh@48 -- # echo ffdhe6144 00:31:55.990 21:32:50 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:55.990 21:32:50 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:31:55.990 21:32:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:55.991 21:32:50 -- host/auth.sh@68 -- # digest=sha256 00:31:55.991 21:32:50 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:31:55.991 21:32:50 -- host/auth.sh@68 -- # keyid=1 00:31:55.991 21:32:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:31:55.991 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:55.991 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:56.249 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:56.249 21:32:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:56.249 21:32:50 -- nvmf/common.sh@717 -- # local ip 00:31:56.249 21:32:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:56.249 21:32:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:56.249 21:32:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:56.249 21:32:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:56.249 21:32:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:56.249 21:32:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:56.249 21:32:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:56.249 21:32:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:56.249 21:32:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:56.249 21:32:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:56.249 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:56.249 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:56.508 nvme0n1 00:31:56.508 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:56.508 21:32:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:56.508 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:56.508 21:32:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:56.508 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:56.508 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:56.508 21:32:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:56.508 21:32:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:56.508 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:56.508 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:56.508 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:56.508 21:32:50 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:56.508 21:32:50 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:31:56.508 21:32:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:56.508 21:32:50 -- host/auth.sh@44 -- # digest=sha256 00:31:56.508 21:32:50 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:31:56.508 21:32:50 -- host/auth.sh@44 -- # keyid=2 00:31:56.508 21:32:50 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:56.508 21:32:50 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:56.508 21:32:50 -- host/auth.sh@48 -- # echo ffdhe6144 00:31:56.508 21:32:50 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:56.508 21:32:50 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:31:56.508 21:32:50 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:56.508 21:32:50 -- host/auth.sh@68 -- # digest=sha256 00:31:56.508 21:32:50 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:31:56.508 21:32:50 -- host/auth.sh@68 -- # keyid=2 00:31:56.508 21:32:50 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:31:56.508 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:56.508 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:56.508 21:32:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:56.508 21:32:50 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:56.508 21:32:50 -- nvmf/common.sh@717 -- # local ip 00:31:56.508 21:32:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:56.508 21:32:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:56.508 21:32:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:56.508 21:32:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:56.508 21:32:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:56.508 21:32:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:56.508 21:32:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:56.508 21:32:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:56.508 21:32:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:56.508 21:32:50 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:31:56.508 21:32:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:56.508 21:32:50 -- common/autotest_common.sh@10 -- # set +x 00:31:57.075 nvme0n1 00:31:57.075 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.075 21:32:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:57.075 21:32:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:57.075 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.075 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.075 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.075 21:32:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:57.075 21:32:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:57.075 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.075 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.075 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.075 21:32:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:57.075 21:32:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:31:57.076 21:32:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:57.076 21:32:51 -- host/auth.sh@44 -- # digest=sha256 00:31:57.076 21:32:51 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:31:57.076 21:32:51 -- host/auth.sh@44 -- # keyid=3 00:31:57.076 21:32:51 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:57.076 21:32:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:57.076 21:32:51 -- host/auth.sh@48 -- # echo ffdhe6144 00:31:57.076 21:32:51 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:57.076 21:32:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:31:57.076 21:32:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:57.076 21:32:51 -- host/auth.sh@68 -- # digest=sha256 00:31:57.076 21:32:51 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:31:57.076 21:32:51 -- host/auth.sh@68 -- # keyid=3 00:31:57.076 21:32:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:31:57.076 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.076 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.076 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.076 21:32:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:57.076 21:32:51 -- nvmf/common.sh@717 -- # local ip 00:31:57.076 21:32:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:57.076 21:32:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:57.076 21:32:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:57.076 21:32:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:57.076 21:32:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:57.076 21:32:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:57.076 21:32:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:57.076 21:32:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:57.076 21:32:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:57.076 21:32:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:31:57.076 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.076 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.335 nvme0n1 00:31:57.335 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.335 21:32:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:57.335 21:32:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:57.335 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.335 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.335 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.335 21:32:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:57.335 21:32:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:57.335 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.335 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.335 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.335 21:32:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:57.335 21:32:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:31:57.335 21:32:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:57.335 21:32:51 -- host/auth.sh@44 -- # digest=sha256 00:31:57.335 21:32:51 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:31:57.335 21:32:51 -- host/auth.sh@44 -- # keyid=4 00:31:57.335 21:32:51 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:57.335 21:32:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:57.335 21:32:51 -- host/auth.sh@48 -- # echo ffdhe6144 00:31:57.335 21:32:51 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:31:57.335 21:32:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:31:57.335 21:32:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:57.335 21:32:51 -- host/auth.sh@68 -- # digest=sha256 00:31:57.335 21:32:51 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:31:57.335 21:32:51 -- host/auth.sh@68 -- # keyid=4 00:31:57.335 21:32:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:31:57.335 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.335 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.335 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.335 21:32:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:57.335 21:32:51 -- nvmf/common.sh@717 -- # local ip 00:31:57.335 21:32:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:57.335 21:32:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:57.335 21:32:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:57.335 21:32:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:57.335 21:32:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:57.335 21:32:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:57.335 21:32:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:57.335 21:32:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:57.335 21:32:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:57.335 21:32:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:31:57.335 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.335 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.911 nvme0n1 00:31:57.911 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.911 21:32:51 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:57.911 21:32:51 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:57.911 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.911 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.911 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.911 21:32:51 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:57.911 21:32:51 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:57.911 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.911 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.911 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.911 21:32:51 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:31:57.911 21:32:51 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:57.911 21:32:51 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:31:57.911 21:32:51 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:57.911 21:32:51 -- host/auth.sh@44 -- # digest=sha256 00:31:57.911 21:32:51 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:31:57.911 21:32:51 -- host/auth.sh@44 -- # keyid=0 00:31:57.911 21:32:51 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:57.911 21:32:51 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:57.911 21:32:51 -- host/auth.sh@48 -- # echo ffdhe8192 00:31:57.911 21:32:51 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:31:57.911 21:32:51 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:31:57.911 21:32:51 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:57.911 21:32:51 -- host/auth.sh@68 -- # digest=sha256 00:31:57.911 21:32:51 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:31:57.911 21:32:51 -- host/auth.sh@68 -- # keyid=0 00:31:57.911 21:32:51 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:31:57.911 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.911 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:57.911 21:32:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:57.911 21:32:51 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:57.911 21:32:51 -- nvmf/common.sh@717 -- # local ip 00:31:57.911 21:32:51 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:57.911 21:32:51 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:57.911 21:32:51 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:57.911 21:32:51 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:57.911 21:32:51 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:57.911 21:32:51 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:57.911 21:32:51 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:57.911 21:32:51 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:57.911 21:32:51 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:57.911 21:32:51 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:31:57.911 21:32:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:57.911 21:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:58.478 nvme0n1 00:31:58.478 21:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:58.478 21:32:52 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:58.478 21:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:58.478 21:32:52 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:58.478 21:32:52 -- common/autotest_common.sh@10 -- # set +x 00:31:58.478 21:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:58.478 21:32:52 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:58.478 21:32:52 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:58.478 21:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:58.478 21:32:52 -- common/autotest_common.sh@10 -- # set +x 00:31:58.478 21:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:58.478 21:32:52 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:58.478 21:32:52 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:31:58.479 21:32:52 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:58.479 21:32:52 -- host/auth.sh@44 -- # digest=sha256 00:31:58.479 21:32:52 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:31:58.479 21:32:52 -- host/auth.sh@44 -- # keyid=1 00:31:58.479 21:32:52 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:58.479 21:32:52 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:58.479 21:32:52 -- host/auth.sh@48 -- # echo ffdhe8192 00:31:58.479 21:32:52 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:31:58.479 21:32:52 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:31:58.479 21:32:52 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:58.479 21:32:52 -- host/auth.sh@68 -- # digest=sha256 00:31:58.479 21:32:52 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:31:58.479 21:32:52 -- host/auth.sh@68 -- # keyid=1 00:31:58.479 21:32:52 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:31:58.479 21:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:58.479 21:32:52 -- common/autotest_common.sh@10 -- # set +x 00:31:58.479 21:32:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:58.479 21:32:52 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:58.479 21:32:52 -- nvmf/common.sh@717 -- # local ip 00:31:58.479 21:32:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:58.479 21:32:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:58.479 21:32:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:58.479 21:32:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:58.479 21:32:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:58.479 21:32:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:58.479 21:32:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:58.479 21:32:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:58.479 21:32:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:58.479 21:32:52 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:31:58.479 21:32:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:58.479 21:32:52 -- common/autotest_common.sh@10 -- # set +x 00:31:59.045 nvme0n1 00:31:59.045 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.045 21:32:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:59.045 21:32:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:59.045 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.045 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.045 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.045 21:32:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:59.045 21:32:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:59.045 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.045 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.045 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.045 21:32:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:59.045 21:32:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:31:59.045 21:32:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:59.045 21:32:53 -- host/auth.sh@44 -- # digest=sha256 00:31:59.045 21:32:53 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:31:59.045 21:32:53 -- host/auth.sh@44 -- # keyid=2 00:31:59.045 21:32:53 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:59.045 21:32:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:59.045 21:32:53 -- host/auth.sh@48 -- # echo ffdhe8192 00:31:59.045 21:32:53 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:31:59.045 21:32:53 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:31:59.045 21:32:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:59.045 21:32:53 -- host/auth.sh@68 -- # digest=sha256 00:31:59.045 21:32:53 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:31:59.045 21:32:53 -- host/auth.sh@68 -- # keyid=2 00:31:59.045 21:32:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:31:59.045 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.045 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.045 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.045 21:32:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:59.045 21:32:53 -- nvmf/common.sh@717 -- # local ip 00:31:59.045 21:32:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:59.045 21:32:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:59.045 21:32:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:59.045 21:32:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:59.045 21:32:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:59.045 21:32:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:59.045 21:32:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:59.045 21:32:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:59.045 21:32:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:59.045 21:32:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:31:59.045 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.045 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.612 nvme0n1 00:31:59.612 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.612 21:32:53 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:31:59.612 21:32:53 -- host/auth.sh@73 -- # jq -r '.[].name' 00:31:59.612 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.612 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.612 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.612 21:32:53 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:31:59.612 21:32:53 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:31:59.612 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.612 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.612 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.612 21:32:53 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:31:59.612 21:32:53 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:31:59.612 21:32:53 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:31:59.612 21:32:53 -- host/auth.sh@44 -- # digest=sha256 00:31:59.612 21:32:53 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:31:59.612 21:32:53 -- host/auth.sh@44 -- # keyid=3 00:31:59.612 21:32:53 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:59.612 21:32:53 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:31:59.612 21:32:53 -- host/auth.sh@48 -- # echo ffdhe8192 00:31:59.612 21:32:53 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:31:59.612 21:32:53 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:31:59.612 21:32:53 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:31:59.612 21:32:53 -- host/auth.sh@68 -- # digest=sha256 00:31:59.612 21:32:53 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:31:59.612 21:32:53 -- host/auth.sh@68 -- # keyid=3 00:31:59.612 21:32:53 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:31:59.612 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.612 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:31:59.612 21:32:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:59.612 21:32:53 -- host/auth.sh@70 -- # get_main_ns_ip 00:31:59.612 21:32:53 -- nvmf/common.sh@717 -- # local ip 00:31:59.612 21:32:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:59.612 21:32:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:59.612 21:32:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:59.612 21:32:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:59.612 21:32:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:59.612 21:32:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:59.612 21:32:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:59.612 21:32:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:59.612 21:32:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:59.612 21:32:53 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:31:59.612 21:32:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:59.612 21:32:53 -- common/autotest_common.sh@10 -- # set +x 00:32:00.179 nvme0n1 00:32:00.179 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.179 21:32:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:00.179 21:32:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:00.179 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.179 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.179 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.179 21:32:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:00.179 21:32:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:00.179 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.179 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.179 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.179 21:32:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:00.179 21:32:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:32:00.179 21:32:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:00.179 21:32:54 -- host/auth.sh@44 -- # digest=sha256 00:32:00.179 21:32:54 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:00.179 21:32:54 -- host/auth.sh@44 -- # keyid=4 00:32:00.179 21:32:54 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:00.179 21:32:54 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:00.179 21:32:54 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:00.179 21:32:54 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:00.179 21:32:54 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:32:00.179 21:32:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:00.179 21:32:54 -- host/auth.sh@68 -- # digest=sha256 00:32:00.179 21:32:54 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:00.179 21:32:54 -- host/auth.sh@68 -- # keyid=4 00:32:00.179 21:32:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:00.179 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.179 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.179 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.179 21:32:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:00.179 21:32:54 -- nvmf/common.sh@717 -- # local ip 00:32:00.179 21:32:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:00.179 21:32:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:00.179 21:32:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:00.179 21:32:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:00.179 21:32:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:00.179 21:32:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:00.179 21:32:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:00.179 21:32:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:00.179 21:32:54 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:00.179 21:32:54 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:00.179 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.179 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.751 nvme0n1 00:32:00.751 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.751 21:32:54 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:00.751 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.751 21:32:54 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:00.751 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.751 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.751 21:32:54 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:00.751 21:32:54 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:00.751 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.751 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.751 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.751 21:32:54 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:00.751 21:32:54 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:00.751 21:32:54 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:00.751 21:32:54 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:32:00.751 21:32:54 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:00.751 21:32:54 -- host/auth.sh@44 -- # digest=sha384 00:32:00.751 21:32:54 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:00.751 21:32:54 -- host/auth.sh@44 -- # keyid=0 00:32:00.751 21:32:54 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:00.751 21:32:54 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:00.751 21:32:54 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:00.751 21:32:54 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:00.751 21:32:54 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:32:00.751 21:32:54 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:00.751 21:32:54 -- host/auth.sh@68 -- # digest=sha384 00:32:00.751 21:32:54 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:00.751 21:32:54 -- host/auth.sh@68 -- # keyid=0 00:32:00.751 21:32:54 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:00.751 21:32:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.751 21:32:54 -- common/autotest_common.sh@10 -- # set +x 00:32:00.751 21:32:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:00.751 21:32:54 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:00.751 21:32:54 -- nvmf/common.sh@717 -- # local ip 00:32:00.751 21:32:54 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:00.751 21:32:54 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:00.751 21:32:54 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:00.751 21:32:54 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:00.751 21:32:54 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:00.751 21:32:54 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:00.751 21:32:54 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:00.751 21:32:54 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:00.751 21:32:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:00.751 21:32:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:00.751 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:00.751 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.011 nvme0n1 00:32:01.011 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.011 21:32:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:01.011 21:32:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:01.011 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.011 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.011 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.011 21:32:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:01.011 21:32:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:01.011 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.011 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.011 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.011 21:32:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:01.011 21:32:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:32:01.011 21:32:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:01.011 21:32:55 -- host/auth.sh@44 -- # digest=sha384 00:32:01.011 21:32:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:01.011 21:32:55 -- host/auth.sh@44 -- # keyid=1 00:32:01.011 21:32:55 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:01.011 21:32:55 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:01.011 21:32:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:01.011 21:32:55 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:01.011 21:32:55 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:32:01.011 21:32:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:01.011 21:32:55 -- host/auth.sh@68 -- # digest=sha384 00:32:01.011 21:32:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:01.011 21:32:55 -- host/auth.sh@68 -- # keyid=1 00:32:01.011 21:32:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:01.011 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.011 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.011 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.011 21:32:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:01.012 21:32:55 -- nvmf/common.sh@717 -- # local ip 00:32:01.012 21:32:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:01.012 21:32:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:01.012 21:32:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:01.012 21:32:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:01.012 21:32:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:01.012 21:32:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:01.012 21:32:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:01.012 21:32:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:01.012 21:32:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:01.012 21:32:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:01.012 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.012 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.270 nvme0n1 00:32:01.270 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.270 21:32:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:01.270 21:32:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:01.270 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.270 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.270 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.270 21:32:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:01.270 21:32:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:01.270 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.270 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.270 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.270 21:32:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:01.270 21:32:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:32:01.270 21:32:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:01.270 21:32:55 -- host/auth.sh@44 -- # digest=sha384 00:32:01.270 21:32:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:01.270 21:32:55 -- host/auth.sh@44 -- # keyid=2 00:32:01.270 21:32:55 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:01.270 21:32:55 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:01.270 21:32:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:01.270 21:32:55 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:01.270 21:32:55 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:32:01.270 21:32:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:01.270 21:32:55 -- host/auth.sh@68 -- # digest=sha384 00:32:01.270 21:32:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:01.270 21:32:55 -- host/auth.sh@68 -- # keyid=2 00:32:01.270 21:32:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:01.270 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.270 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.270 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.270 21:32:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:01.270 21:32:55 -- nvmf/common.sh@717 -- # local ip 00:32:01.270 21:32:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:01.270 21:32:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:01.270 21:32:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:01.270 21:32:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:01.270 21:32:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:01.270 21:32:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:01.270 21:32:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:01.270 21:32:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:01.270 21:32:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:01.270 21:32:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:01.270 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.270 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.528 nvme0n1 00:32:01.528 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.528 21:32:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:01.528 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.528 21:32:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:01.528 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.528 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.528 21:32:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:01.528 21:32:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:01.528 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.528 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.528 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.528 21:32:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:01.528 21:32:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:32:01.528 21:32:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:01.528 21:32:55 -- host/auth.sh@44 -- # digest=sha384 00:32:01.528 21:32:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:01.528 21:32:55 -- host/auth.sh@44 -- # keyid=3 00:32:01.528 21:32:55 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:01.528 21:32:55 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:01.528 21:32:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:01.528 21:32:55 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:01.528 21:32:55 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:32:01.528 21:32:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:01.528 21:32:55 -- host/auth.sh@68 -- # digest=sha384 00:32:01.528 21:32:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:01.528 21:32:55 -- host/auth.sh@68 -- # keyid=3 00:32:01.528 21:32:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:01.528 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.528 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.528 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.528 21:32:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:01.528 21:32:55 -- nvmf/common.sh@717 -- # local ip 00:32:01.528 21:32:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:01.528 21:32:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:01.528 21:32:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:01.528 21:32:55 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:01.528 21:32:55 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:01.528 21:32:55 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:01.528 21:32:55 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:01.528 21:32:55 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:01.528 21:32:55 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:01.528 21:32:55 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:01.528 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.528 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.787 nvme0n1 00:32:01.787 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.787 21:32:55 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:01.787 21:32:55 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:01.787 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.787 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.787 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.787 21:32:55 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:01.787 21:32:55 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:01.787 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.787 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.787 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.787 21:32:55 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:01.787 21:32:55 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:32:01.787 21:32:55 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:01.787 21:32:55 -- host/auth.sh@44 -- # digest=sha384 00:32:01.787 21:32:55 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:01.787 21:32:55 -- host/auth.sh@44 -- # keyid=4 00:32:01.787 21:32:55 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:01.787 21:32:55 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:01.787 21:32:55 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:01.787 21:32:55 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:01.787 21:32:55 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:32:01.787 21:32:55 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:01.787 21:32:55 -- host/auth.sh@68 -- # digest=sha384 00:32:01.787 21:32:55 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:01.787 21:32:55 -- host/auth.sh@68 -- # keyid=4 00:32:01.787 21:32:55 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:01.787 21:32:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.787 21:32:55 -- common/autotest_common.sh@10 -- # set +x 00:32:01.787 21:32:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:01.787 21:32:55 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:01.787 21:32:55 -- nvmf/common.sh@717 -- # local ip 00:32:01.787 21:32:55 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:01.787 21:32:55 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:01.787 21:32:55 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:01.787 21:32:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:01.787 21:32:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:01.787 21:32:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:01.787 21:32:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:01.787 21:32:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:01.787 21:32:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:01.787 21:32:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:01.787 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:01.787 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.046 nvme0n1 00:32:02.046 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.046 21:32:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:02.046 21:32:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:02.046 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.046 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.046 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.046 21:32:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:02.046 21:32:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:02.046 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.046 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.046 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.046 21:32:56 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:02.046 21:32:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:02.046 21:32:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:32:02.046 21:32:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:02.046 21:32:56 -- host/auth.sh@44 -- # digest=sha384 00:32:02.046 21:32:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:02.046 21:32:56 -- host/auth.sh@44 -- # keyid=0 00:32:02.046 21:32:56 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:02.046 21:32:56 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:02.046 21:32:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:02.046 21:32:56 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:02.046 21:32:56 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:32:02.046 21:32:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:02.046 21:32:56 -- host/auth.sh@68 -- # digest=sha384 00:32:02.046 21:32:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:02.046 21:32:56 -- host/auth.sh@68 -- # keyid=0 00:32:02.046 21:32:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:02.046 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.046 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.046 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.046 21:32:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:02.046 21:32:56 -- nvmf/common.sh@717 -- # local ip 00:32:02.046 21:32:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:02.046 21:32:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:02.046 21:32:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:02.046 21:32:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:02.046 21:32:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:02.046 21:32:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:02.046 21:32:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:02.046 21:32:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:02.046 21:32:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:02.046 21:32:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:02.046 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.046 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.305 nvme0n1 00:32:02.305 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.305 21:32:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:02.305 21:32:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:02.305 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.305 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.305 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.305 21:32:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:02.305 21:32:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:02.305 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.305 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.305 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.305 21:32:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:02.305 21:32:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:32:02.305 21:32:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:02.305 21:32:56 -- host/auth.sh@44 -- # digest=sha384 00:32:02.305 21:32:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:02.305 21:32:56 -- host/auth.sh@44 -- # keyid=1 00:32:02.305 21:32:56 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:02.305 21:32:56 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:02.305 21:32:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:02.305 21:32:56 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:02.305 21:32:56 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:32:02.305 21:32:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:02.305 21:32:56 -- host/auth.sh@68 -- # digest=sha384 00:32:02.305 21:32:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:02.305 21:32:56 -- host/auth.sh@68 -- # keyid=1 00:32:02.305 21:32:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:02.305 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.305 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.305 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.305 21:32:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:02.305 21:32:56 -- nvmf/common.sh@717 -- # local ip 00:32:02.305 21:32:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:02.305 21:32:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:02.305 21:32:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:02.305 21:32:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:02.305 21:32:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:02.305 21:32:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:02.305 21:32:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:02.305 21:32:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:02.305 21:32:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:02.305 21:32:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:02.305 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.305 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.564 nvme0n1 00:32:02.564 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.564 21:32:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:02.564 21:32:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:02.564 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.564 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.564 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.564 21:32:56 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:02.564 21:32:56 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:02.564 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.564 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.564 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.564 21:32:56 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:02.564 21:32:56 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:32:02.564 21:32:56 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:02.564 21:32:56 -- host/auth.sh@44 -- # digest=sha384 00:32:02.564 21:32:56 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:02.564 21:32:56 -- host/auth.sh@44 -- # keyid=2 00:32:02.564 21:32:56 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:02.564 21:32:56 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:02.564 21:32:56 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:02.564 21:32:56 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:02.564 21:32:56 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:32:02.564 21:32:56 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:02.564 21:32:56 -- host/auth.sh@68 -- # digest=sha384 00:32:02.564 21:32:56 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:02.564 21:32:56 -- host/auth.sh@68 -- # keyid=2 00:32:02.564 21:32:56 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:02.564 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.564 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.564 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.564 21:32:56 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:02.564 21:32:56 -- nvmf/common.sh@717 -- # local ip 00:32:02.564 21:32:56 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:02.564 21:32:56 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:02.564 21:32:56 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:02.564 21:32:56 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:02.564 21:32:56 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:02.564 21:32:56 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:02.564 21:32:56 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:02.564 21:32:56 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:02.564 21:32:56 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:02.564 21:32:56 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:02.564 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.564 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.824 nvme0n1 00:32:02.824 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.824 21:32:56 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:02.824 21:32:56 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:02.824 21:32:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.824 21:32:56 -- common/autotest_common.sh@10 -- # set +x 00:32:02.824 21:32:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.824 21:32:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:02.824 21:32:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:02.824 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.824 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:02.824 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.824 21:32:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:02.824 21:32:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:32:02.824 21:32:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:02.824 21:32:57 -- host/auth.sh@44 -- # digest=sha384 00:32:02.824 21:32:57 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:02.824 21:32:57 -- host/auth.sh@44 -- # keyid=3 00:32:02.824 21:32:57 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:02.824 21:32:57 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:02.824 21:32:57 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:02.824 21:32:57 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:02.824 21:32:57 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:32:02.824 21:32:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:02.824 21:32:57 -- host/auth.sh@68 -- # digest=sha384 00:32:02.824 21:32:57 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:02.824 21:32:57 -- host/auth.sh@68 -- # keyid=3 00:32:02.824 21:32:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:02.824 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.824 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:02.824 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:02.824 21:32:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:02.824 21:32:57 -- nvmf/common.sh@717 -- # local ip 00:32:02.824 21:32:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:02.824 21:32:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:02.824 21:32:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:02.824 21:32:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:02.824 21:32:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:02.824 21:32:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:02.824 21:32:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:02.824 21:32:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:02.824 21:32:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:02.824 21:32:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:02.824 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:02.824 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.084 nvme0n1 00:32:03.084 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.084 21:32:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:03.084 21:32:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:03.084 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.084 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.084 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.084 21:32:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:03.084 21:32:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:03.084 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.084 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.084 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.084 21:32:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:03.084 21:32:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:32:03.084 21:32:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:03.084 21:32:57 -- host/auth.sh@44 -- # digest=sha384 00:32:03.084 21:32:57 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:03.084 21:32:57 -- host/auth.sh@44 -- # keyid=4 00:32:03.084 21:32:57 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:03.084 21:32:57 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:03.084 21:32:57 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:03.084 21:32:57 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:03.084 21:32:57 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:32:03.084 21:32:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:03.084 21:32:57 -- host/auth.sh@68 -- # digest=sha384 00:32:03.084 21:32:57 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:03.084 21:32:57 -- host/auth.sh@68 -- # keyid=4 00:32:03.084 21:32:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:03.084 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.084 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.084 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.084 21:32:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:03.084 21:32:57 -- nvmf/common.sh@717 -- # local ip 00:32:03.084 21:32:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:03.084 21:32:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:03.084 21:32:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:03.084 21:32:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:03.084 21:32:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:03.084 21:32:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:03.084 21:32:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:03.084 21:32:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:03.084 21:32:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:03.084 21:32:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:03.084 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.084 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.344 nvme0n1 00:32:03.344 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.344 21:32:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:03.344 21:32:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:03.344 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.344 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.344 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.344 21:32:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:03.344 21:32:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:03.344 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.344 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.344 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.344 21:32:57 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:03.344 21:32:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:03.344 21:32:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:32:03.344 21:32:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:03.344 21:32:57 -- host/auth.sh@44 -- # digest=sha384 00:32:03.344 21:32:57 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:03.344 21:32:57 -- host/auth.sh@44 -- # keyid=0 00:32:03.344 21:32:57 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:03.344 21:32:57 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:03.344 21:32:57 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:03.344 21:32:57 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:03.344 21:32:57 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:32:03.344 21:32:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:03.344 21:32:57 -- host/auth.sh@68 -- # digest=sha384 00:32:03.344 21:32:57 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:03.344 21:32:57 -- host/auth.sh@68 -- # keyid=0 00:32:03.344 21:32:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:03.344 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.344 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.344 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.344 21:32:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:03.344 21:32:57 -- nvmf/common.sh@717 -- # local ip 00:32:03.344 21:32:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:03.344 21:32:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:03.344 21:32:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:03.344 21:32:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:03.344 21:32:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:03.344 21:32:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:03.344 21:32:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:03.344 21:32:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:03.344 21:32:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:03.344 21:32:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:03.344 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.344 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.603 nvme0n1 00:32:03.603 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.603 21:32:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:03.603 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.603 21:32:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:03.603 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.603 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.603 21:32:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:03.603 21:32:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:03.603 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.603 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.861 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.861 21:32:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:03.862 21:32:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:32:03.862 21:32:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:03.862 21:32:57 -- host/auth.sh@44 -- # digest=sha384 00:32:03.862 21:32:57 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:03.862 21:32:57 -- host/auth.sh@44 -- # keyid=1 00:32:03.862 21:32:57 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:03.862 21:32:57 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:03.862 21:32:57 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:03.862 21:32:57 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:03.862 21:32:57 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:32:03.862 21:32:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:03.862 21:32:57 -- host/auth.sh@68 -- # digest=sha384 00:32:03.862 21:32:57 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:03.862 21:32:57 -- host/auth.sh@68 -- # keyid=1 00:32:03.862 21:32:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:03.862 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.862 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:03.862 21:32:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:03.862 21:32:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:03.862 21:32:57 -- nvmf/common.sh@717 -- # local ip 00:32:03.862 21:32:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:03.862 21:32:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:03.862 21:32:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:03.862 21:32:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:03.862 21:32:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:03.862 21:32:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:03.862 21:32:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:03.862 21:32:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:03.862 21:32:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:03.862 21:32:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:03.862 21:32:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:03.862 21:32:57 -- common/autotest_common.sh@10 -- # set +x 00:32:04.121 nvme0n1 00:32:04.121 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.121 21:32:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:04.121 21:32:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:04.121 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.121 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.121 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.121 21:32:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:04.121 21:32:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:04.121 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.121 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.121 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.121 21:32:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:04.121 21:32:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:32:04.121 21:32:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:04.121 21:32:58 -- host/auth.sh@44 -- # digest=sha384 00:32:04.121 21:32:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:04.121 21:32:58 -- host/auth.sh@44 -- # keyid=2 00:32:04.121 21:32:58 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:04.121 21:32:58 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:04.121 21:32:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:04.121 21:32:58 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:04.121 21:32:58 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:32:04.121 21:32:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:04.121 21:32:58 -- host/auth.sh@68 -- # digest=sha384 00:32:04.121 21:32:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:04.121 21:32:58 -- host/auth.sh@68 -- # keyid=2 00:32:04.121 21:32:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:04.121 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.121 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.121 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.121 21:32:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:04.121 21:32:58 -- nvmf/common.sh@717 -- # local ip 00:32:04.121 21:32:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:04.121 21:32:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:04.121 21:32:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:04.121 21:32:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:04.121 21:32:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:04.121 21:32:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:04.121 21:32:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:04.121 21:32:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:04.121 21:32:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:04.121 21:32:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:04.121 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.121 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.381 nvme0n1 00:32:04.381 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.381 21:32:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:04.381 21:32:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:04.381 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.381 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.381 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.381 21:32:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:04.381 21:32:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:04.381 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.381 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.381 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.381 21:32:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:04.381 21:32:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:32:04.381 21:32:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:04.381 21:32:58 -- host/auth.sh@44 -- # digest=sha384 00:32:04.381 21:32:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:04.381 21:32:58 -- host/auth.sh@44 -- # keyid=3 00:32:04.381 21:32:58 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:04.381 21:32:58 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:04.381 21:32:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:04.381 21:32:58 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:04.381 21:32:58 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:32:04.381 21:32:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:04.381 21:32:58 -- host/auth.sh@68 -- # digest=sha384 00:32:04.381 21:32:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:04.381 21:32:58 -- host/auth.sh@68 -- # keyid=3 00:32:04.381 21:32:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:04.381 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.381 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.381 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.381 21:32:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:04.381 21:32:58 -- nvmf/common.sh@717 -- # local ip 00:32:04.381 21:32:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:04.381 21:32:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:04.381 21:32:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:04.381 21:32:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:04.381 21:32:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:04.381 21:32:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:04.381 21:32:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:04.381 21:32:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:04.381 21:32:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:04.381 21:32:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:04.381 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.381 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.649 nvme0n1 00:32:04.649 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.649 21:32:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:04.649 21:32:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:04.649 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.649 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.649 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.649 21:32:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:04.649 21:32:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:04.649 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.649 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.649 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.649 21:32:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:04.649 21:32:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:32:04.649 21:32:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:04.649 21:32:58 -- host/auth.sh@44 -- # digest=sha384 00:32:04.649 21:32:58 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:04.649 21:32:58 -- host/auth.sh@44 -- # keyid=4 00:32:04.649 21:32:58 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:04.650 21:32:58 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:04.650 21:32:58 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:04.650 21:32:58 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:04.650 21:32:58 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:32:04.650 21:32:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:04.650 21:32:58 -- host/auth.sh@68 -- # digest=sha384 00:32:04.650 21:32:58 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:04.650 21:32:58 -- host/auth.sh@68 -- # keyid=4 00:32:04.650 21:32:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:04.650 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.650 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.650 21:32:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.650 21:32:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:04.650 21:32:58 -- nvmf/common.sh@717 -- # local ip 00:32:04.650 21:32:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:04.650 21:32:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:04.650 21:32:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:04.650 21:32:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:04.650 21:32:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:04.650 21:32:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:04.650 21:32:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:04.650 21:32:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:04.650 21:32:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:04.650 21:32:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:04.650 21:32:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.650 21:32:58 -- common/autotest_common.sh@10 -- # set +x 00:32:04.945 nvme0n1 00:32:04.945 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.945 21:32:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:04.945 21:32:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:04.945 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.945 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:04.945 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.945 21:32:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:04.945 21:32:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:04.945 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.945 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:04.945 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.945 21:32:59 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:04.945 21:32:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:04.945 21:32:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:32:04.945 21:32:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:04.945 21:32:59 -- host/auth.sh@44 -- # digest=sha384 00:32:04.945 21:32:59 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:04.945 21:32:59 -- host/auth.sh@44 -- # keyid=0 00:32:04.945 21:32:59 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:04.945 21:32:59 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:04.945 21:32:59 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:04.945 21:32:59 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:04.945 21:32:59 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:32:04.945 21:32:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:04.945 21:32:59 -- host/auth.sh@68 -- # digest=sha384 00:32:04.945 21:32:59 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:04.945 21:32:59 -- host/auth.sh@68 -- # keyid=0 00:32:04.945 21:32:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:04.945 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.945 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:04.945 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.945 21:32:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:04.945 21:32:59 -- nvmf/common.sh@717 -- # local ip 00:32:04.945 21:32:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:04.945 21:32:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:04.945 21:32:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:04.945 21:32:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:04.945 21:32:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:04.945 21:32:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:04.945 21:32:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:04.945 21:32:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:04.945 21:32:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:04.945 21:32:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:04.945 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.945 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.519 nvme0n1 00:32:05.519 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.519 21:32:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:05.519 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.519 21:32:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:05.519 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.519 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.519 21:32:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:05.519 21:32:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:05.519 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.519 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.519 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.519 21:32:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:05.519 21:32:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:32:05.519 21:32:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:05.519 21:32:59 -- host/auth.sh@44 -- # digest=sha384 00:32:05.519 21:32:59 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:05.519 21:32:59 -- host/auth.sh@44 -- # keyid=1 00:32:05.519 21:32:59 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:05.519 21:32:59 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:05.519 21:32:59 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:05.519 21:32:59 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:05.519 21:32:59 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:32:05.519 21:32:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:05.519 21:32:59 -- host/auth.sh@68 -- # digest=sha384 00:32:05.519 21:32:59 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:05.519 21:32:59 -- host/auth.sh@68 -- # keyid=1 00:32:05.519 21:32:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:05.519 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.519 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.519 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.519 21:32:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:05.519 21:32:59 -- nvmf/common.sh@717 -- # local ip 00:32:05.519 21:32:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:05.519 21:32:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:05.519 21:32:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:05.519 21:32:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:05.519 21:32:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:05.519 21:32:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:05.519 21:32:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:05.519 21:32:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:05.519 21:32:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:05.519 21:32:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:05.519 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.519 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.778 nvme0n1 00:32:05.778 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.778 21:32:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:05.778 21:32:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.778 21:32:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:05.778 21:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:05.778 21:32:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.778 21:33:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:05.778 21:33:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:05.778 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.778 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:05.778 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.778 21:33:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:05.778 21:33:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:32:05.778 21:33:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:05.778 21:33:00 -- host/auth.sh@44 -- # digest=sha384 00:32:05.778 21:33:00 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:05.778 21:33:00 -- host/auth.sh@44 -- # keyid=2 00:32:05.778 21:33:00 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:05.778 21:33:00 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:05.778 21:33:00 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:05.778 21:33:00 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:05.778 21:33:00 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:32:05.778 21:33:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:05.778 21:33:00 -- host/auth.sh@68 -- # digest=sha384 00:32:05.778 21:33:00 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:05.778 21:33:00 -- host/auth.sh@68 -- # keyid=2 00:32:05.778 21:33:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:05.778 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.778 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:05.778 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.778 21:33:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:05.778 21:33:00 -- nvmf/common.sh@717 -- # local ip 00:32:05.778 21:33:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:05.778 21:33:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:05.778 21:33:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:05.778 21:33:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:05.778 21:33:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:05.778 21:33:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:05.778 21:33:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:05.778 21:33:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:05.778 21:33:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:05.778 21:33:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:05.778 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.778 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.346 nvme0n1 00:32:06.346 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.346 21:33:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:06.346 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.346 21:33:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:06.346 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.346 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.346 21:33:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:06.346 21:33:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:06.346 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.346 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.346 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.346 21:33:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:06.346 21:33:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:32:06.346 21:33:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:06.346 21:33:00 -- host/auth.sh@44 -- # digest=sha384 00:32:06.346 21:33:00 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:06.346 21:33:00 -- host/auth.sh@44 -- # keyid=3 00:32:06.346 21:33:00 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:06.346 21:33:00 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:06.346 21:33:00 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:06.346 21:33:00 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:06.346 21:33:00 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:32:06.346 21:33:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:06.346 21:33:00 -- host/auth.sh@68 -- # digest=sha384 00:32:06.346 21:33:00 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:06.346 21:33:00 -- host/auth.sh@68 -- # keyid=3 00:32:06.346 21:33:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:06.346 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.346 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.346 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.346 21:33:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:06.346 21:33:00 -- nvmf/common.sh@717 -- # local ip 00:32:06.346 21:33:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:06.346 21:33:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:06.346 21:33:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:06.346 21:33:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:06.346 21:33:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:06.346 21:33:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:06.346 21:33:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:06.346 21:33:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:06.346 21:33:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:06.346 21:33:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:06.346 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.346 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.605 nvme0n1 00:32:06.605 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.605 21:33:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:06.605 21:33:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:06.605 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.605 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.605 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.605 21:33:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:06.605 21:33:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:06.605 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.605 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.864 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.864 21:33:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:06.864 21:33:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:32:06.864 21:33:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:06.864 21:33:00 -- host/auth.sh@44 -- # digest=sha384 00:32:06.864 21:33:00 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:06.864 21:33:00 -- host/auth.sh@44 -- # keyid=4 00:32:06.864 21:33:00 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:06.864 21:33:00 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:06.864 21:33:00 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:06.864 21:33:00 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:06.864 21:33:00 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:32:06.864 21:33:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:06.864 21:33:00 -- host/auth.sh@68 -- # digest=sha384 00:32:06.864 21:33:00 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:06.864 21:33:00 -- host/auth.sh@68 -- # keyid=4 00:32:06.864 21:33:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:06.864 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.864 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:06.864 21:33:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:06.864 21:33:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:06.864 21:33:00 -- nvmf/common.sh@717 -- # local ip 00:32:06.865 21:33:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:06.865 21:33:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:06.865 21:33:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:06.865 21:33:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:06.865 21:33:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:06.865 21:33:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:06.865 21:33:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:06.865 21:33:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:06.865 21:33:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:06.865 21:33:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:06.865 21:33:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:06.865 21:33:00 -- common/autotest_common.sh@10 -- # set +x 00:32:07.124 nvme0n1 00:32:07.124 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.124 21:33:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:07.124 21:33:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:07.124 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.124 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.124 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.124 21:33:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:07.124 21:33:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:07.124 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.124 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.124 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.124 21:33:01 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:07.124 21:33:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:07.124 21:33:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:32:07.124 21:33:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:07.124 21:33:01 -- host/auth.sh@44 -- # digest=sha384 00:32:07.124 21:33:01 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:07.124 21:33:01 -- host/auth.sh@44 -- # keyid=0 00:32:07.124 21:33:01 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:07.124 21:33:01 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:07.124 21:33:01 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:07.124 21:33:01 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:07.124 21:33:01 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:32:07.124 21:33:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:07.124 21:33:01 -- host/auth.sh@68 -- # digest=sha384 00:32:07.124 21:33:01 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:07.124 21:33:01 -- host/auth.sh@68 -- # keyid=0 00:32:07.124 21:33:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:07.124 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.124 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.124 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.124 21:33:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:07.124 21:33:01 -- nvmf/common.sh@717 -- # local ip 00:32:07.124 21:33:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:07.124 21:33:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:07.124 21:33:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:07.124 21:33:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:07.124 21:33:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:07.124 21:33:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:07.124 21:33:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:07.124 21:33:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:07.124 21:33:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:07.124 21:33:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:07.124 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.124 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.691 nvme0n1 00:32:07.691 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.691 21:33:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:07.691 21:33:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:07.691 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.691 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.691 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.691 21:33:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:07.691 21:33:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:07.691 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.691 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.691 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.691 21:33:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:07.691 21:33:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:32:07.691 21:33:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:07.691 21:33:01 -- host/auth.sh@44 -- # digest=sha384 00:32:07.691 21:33:01 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:07.691 21:33:01 -- host/auth.sh@44 -- # keyid=1 00:32:07.691 21:33:01 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:07.691 21:33:01 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:07.691 21:33:01 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:07.691 21:33:01 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:07.691 21:33:01 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:32:07.691 21:33:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:07.691 21:33:01 -- host/auth.sh@68 -- # digest=sha384 00:32:07.691 21:33:01 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:07.691 21:33:01 -- host/auth.sh@68 -- # keyid=1 00:32:07.691 21:33:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:07.691 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.691 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:07.691 21:33:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:07.691 21:33:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:07.691 21:33:01 -- nvmf/common.sh@717 -- # local ip 00:32:07.691 21:33:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:07.691 21:33:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:07.691 21:33:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:07.691 21:33:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:07.691 21:33:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:07.691 21:33:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:07.691 21:33:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:07.691 21:33:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:07.691 21:33:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:07.691 21:33:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:07.691 21:33:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:07.691 21:33:01 -- common/autotest_common.sh@10 -- # set +x 00:32:08.258 nvme0n1 00:32:08.258 21:33:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:08.258 21:33:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:08.258 21:33:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:08.258 21:33:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:08.258 21:33:02 -- common/autotest_common.sh@10 -- # set +x 00:32:08.258 21:33:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:08.258 21:33:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:08.258 21:33:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:08.259 21:33:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:08.259 21:33:02 -- common/autotest_common.sh@10 -- # set +x 00:32:08.517 21:33:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:08.517 21:33:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:08.517 21:33:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:32:08.517 21:33:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:08.517 21:33:02 -- host/auth.sh@44 -- # digest=sha384 00:32:08.517 21:33:02 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:08.517 21:33:02 -- host/auth.sh@44 -- # keyid=2 00:32:08.517 21:33:02 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:08.517 21:33:02 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:08.517 21:33:02 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:08.517 21:33:02 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:08.517 21:33:02 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:32:08.517 21:33:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:08.517 21:33:02 -- host/auth.sh@68 -- # digest=sha384 00:32:08.517 21:33:02 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:08.517 21:33:02 -- host/auth.sh@68 -- # keyid=2 00:32:08.517 21:33:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:08.517 21:33:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:08.517 21:33:02 -- common/autotest_common.sh@10 -- # set +x 00:32:08.517 21:33:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:08.517 21:33:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:08.517 21:33:02 -- nvmf/common.sh@717 -- # local ip 00:32:08.517 21:33:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:08.517 21:33:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:08.517 21:33:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:08.517 21:33:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:08.517 21:33:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:08.517 21:33:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:08.517 21:33:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:08.517 21:33:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:08.517 21:33:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:08.517 21:33:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:08.517 21:33:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:08.517 21:33:02 -- common/autotest_common.sh@10 -- # set +x 00:32:09.083 nvme0n1 00:32:09.083 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.083 21:33:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:09.083 21:33:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:09.083 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.083 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.083 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.083 21:33:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:09.083 21:33:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:09.083 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.083 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.083 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.083 21:33:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:09.083 21:33:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:32:09.083 21:33:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:09.083 21:33:03 -- host/auth.sh@44 -- # digest=sha384 00:32:09.083 21:33:03 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:09.083 21:33:03 -- host/auth.sh@44 -- # keyid=3 00:32:09.083 21:33:03 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:09.083 21:33:03 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:09.083 21:33:03 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:09.083 21:33:03 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:09.083 21:33:03 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:32:09.083 21:33:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:09.083 21:33:03 -- host/auth.sh@68 -- # digest=sha384 00:32:09.083 21:33:03 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:09.083 21:33:03 -- host/auth.sh@68 -- # keyid=3 00:32:09.083 21:33:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:09.083 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.083 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.083 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.083 21:33:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:09.083 21:33:03 -- nvmf/common.sh@717 -- # local ip 00:32:09.083 21:33:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:09.083 21:33:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:09.083 21:33:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:09.083 21:33:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:09.083 21:33:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:09.083 21:33:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:09.083 21:33:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:09.083 21:33:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:09.083 21:33:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:09.083 21:33:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:09.083 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.083 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.651 nvme0n1 00:32:09.651 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.651 21:33:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:09.651 21:33:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:09.651 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.651 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.651 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.651 21:33:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:09.651 21:33:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:09.651 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.651 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.651 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.651 21:33:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:09.651 21:33:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:32:09.651 21:33:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:09.651 21:33:03 -- host/auth.sh@44 -- # digest=sha384 00:32:09.651 21:33:03 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:09.651 21:33:03 -- host/auth.sh@44 -- # keyid=4 00:32:09.651 21:33:03 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:09.651 21:33:03 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:09.651 21:33:03 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:09.651 21:33:03 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:09.651 21:33:03 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:32:09.651 21:33:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:09.651 21:33:03 -- host/auth.sh@68 -- # digest=sha384 00:32:09.651 21:33:03 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:09.651 21:33:03 -- host/auth.sh@68 -- # keyid=4 00:32:09.651 21:33:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:09.651 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.651 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:09.651 21:33:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:09.651 21:33:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:09.651 21:33:03 -- nvmf/common.sh@717 -- # local ip 00:32:09.651 21:33:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:09.651 21:33:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:09.651 21:33:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:09.651 21:33:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:09.651 21:33:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:09.651 21:33:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:09.651 21:33:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:09.651 21:33:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:09.651 21:33:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:09.651 21:33:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:09.651 21:33:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:09.651 21:33:03 -- common/autotest_common.sh@10 -- # set +x 00:32:10.218 nvme0n1 00:32:10.218 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.218 21:33:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.218 21:33:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.218 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.218 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.218 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.218 21:33:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.218 21:33:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.218 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.218 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.218 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.218 21:33:04 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:10.218 21:33:04 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:10.218 21:33:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.218 21:33:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:32:10.218 21:33:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.218 21:33:04 -- host/auth.sh@44 -- # digest=sha512 00:32:10.218 21:33:04 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.218 21:33:04 -- host/auth.sh@44 -- # keyid=0 00:32:10.218 21:33:04 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:10.218 21:33:04 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:10.218 21:33:04 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.218 21:33:04 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:10.218 21:33:04 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:32:10.218 21:33:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.218 21:33:04 -- host/auth.sh@68 -- # digest=sha512 00:32:10.218 21:33:04 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.218 21:33:04 -- host/auth.sh@68 -- # keyid=0 00:32:10.218 21:33:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:10.218 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.218 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.218 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.218 21:33:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.218 21:33:04 -- nvmf/common.sh@717 -- # local ip 00:32:10.218 21:33:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.218 21:33:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.218 21:33:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.218 21:33:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.218 21:33:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.218 21:33:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.218 21:33:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.218 21:33:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.218 21:33:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.218 21:33:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:10.218 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.218 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.476 nvme0n1 00:32:10.476 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.476 21:33:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.476 21:33:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.476 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.476 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.476 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.476 21:33:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.476 21:33:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.476 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.477 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.477 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.477 21:33:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.477 21:33:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:32:10.477 21:33:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.477 21:33:04 -- host/auth.sh@44 -- # digest=sha512 00:32:10.477 21:33:04 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.477 21:33:04 -- host/auth.sh@44 -- # keyid=1 00:32:10.477 21:33:04 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:10.477 21:33:04 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:10.477 21:33:04 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.477 21:33:04 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:10.477 21:33:04 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:32:10.477 21:33:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.477 21:33:04 -- host/auth.sh@68 -- # digest=sha512 00:32:10.477 21:33:04 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.477 21:33:04 -- host/auth.sh@68 -- # keyid=1 00:32:10.477 21:33:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:10.477 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.477 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.477 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.477 21:33:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.477 21:33:04 -- nvmf/common.sh@717 -- # local ip 00:32:10.477 21:33:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.477 21:33:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.477 21:33:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.477 21:33:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.477 21:33:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.477 21:33:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.477 21:33:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.477 21:33:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.477 21:33:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.477 21:33:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:10.477 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.477 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.736 nvme0n1 00:32:10.736 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.736 21:33:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.736 21:33:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.736 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.736 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.736 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.736 21:33:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.736 21:33:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.736 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.736 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.736 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.736 21:33:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.736 21:33:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:32:10.736 21:33:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.736 21:33:04 -- host/auth.sh@44 -- # digest=sha512 00:32:10.736 21:33:04 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.736 21:33:04 -- host/auth.sh@44 -- # keyid=2 00:32:10.736 21:33:04 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:10.736 21:33:04 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:10.736 21:33:04 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.736 21:33:04 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:10.736 21:33:04 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:32:10.736 21:33:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.736 21:33:04 -- host/auth.sh@68 -- # digest=sha512 00:32:10.736 21:33:04 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.736 21:33:04 -- host/auth.sh@68 -- # keyid=2 00:32:10.736 21:33:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:10.736 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.736 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.736 21:33:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.736 21:33:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.736 21:33:04 -- nvmf/common.sh@717 -- # local ip 00:32:10.736 21:33:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.736 21:33:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.736 21:33:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.736 21:33:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.736 21:33:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.736 21:33:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.736 21:33:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.736 21:33:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.736 21:33:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.736 21:33:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:10.736 21:33:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.736 21:33:04 -- common/autotest_common.sh@10 -- # set +x 00:32:10.995 nvme0n1 00:32:10.995 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.995 21:33:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.995 21:33:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.995 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.995 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:10.995 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.995 21:33:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.995 21:33:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.995 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.995 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:10.995 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.995 21:33:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.995 21:33:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:32:10.995 21:33:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.995 21:33:05 -- host/auth.sh@44 -- # digest=sha512 00:32:10.995 21:33:05 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.995 21:33:05 -- host/auth.sh@44 -- # keyid=3 00:32:10.995 21:33:05 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:10.995 21:33:05 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:10.995 21:33:05 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.995 21:33:05 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:10.995 21:33:05 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:32:10.995 21:33:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.996 21:33:05 -- host/auth.sh@68 -- # digest=sha512 00:32:10.996 21:33:05 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.996 21:33:05 -- host/auth.sh@68 -- # keyid=3 00:32:10.996 21:33:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:10.996 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.996 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:10.996 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.996 21:33:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.996 21:33:05 -- nvmf/common.sh@717 -- # local ip 00:32:10.996 21:33:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.996 21:33:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.996 21:33:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.996 21:33:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.996 21:33:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.996 21:33:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.996 21:33:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.996 21:33:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.996 21:33:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.996 21:33:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:10.996 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.996 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.254 nvme0n1 00:32:11.254 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.254 21:33:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.254 21:33:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.254 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.254 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.254 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.254 21:33:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.254 21:33:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.254 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.254 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.254 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.254 21:33:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.254 21:33:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:32:11.254 21:33:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.254 21:33:05 -- host/auth.sh@44 -- # digest=sha512 00:32:11.254 21:33:05 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.254 21:33:05 -- host/auth.sh@44 -- # keyid=4 00:32:11.254 21:33:05 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:11.254 21:33:05 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:11.254 21:33:05 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.254 21:33:05 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:11.254 21:33:05 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:32:11.254 21:33:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.254 21:33:05 -- host/auth.sh@68 -- # digest=sha512 00:32:11.254 21:33:05 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.254 21:33:05 -- host/auth.sh@68 -- # keyid=4 00:32:11.254 21:33:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:11.254 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.254 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.254 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.254 21:33:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.254 21:33:05 -- nvmf/common.sh@717 -- # local ip 00:32:11.254 21:33:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.254 21:33:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.254 21:33:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.254 21:33:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.254 21:33:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.254 21:33:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.254 21:33:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.254 21:33:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.254 21:33:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.254 21:33:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:11.254 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.254 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.513 nvme0n1 00:32:11.513 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.513 21:33:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.513 21:33:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.513 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.513 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.513 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.513 21:33:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.513 21:33:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.513 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.513 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.513 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.513 21:33:05 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:11.513 21:33:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.513 21:33:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:32:11.513 21:33:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.513 21:33:05 -- host/auth.sh@44 -- # digest=sha512 00:32:11.513 21:33:05 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:11.513 21:33:05 -- host/auth.sh@44 -- # keyid=0 00:32:11.513 21:33:05 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:11.513 21:33:05 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:11.513 21:33:05 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:11.513 21:33:05 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:11.513 21:33:05 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:32:11.513 21:33:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.513 21:33:05 -- host/auth.sh@68 -- # digest=sha512 00:32:11.513 21:33:05 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:11.513 21:33:05 -- host/auth.sh@68 -- # keyid=0 00:32:11.513 21:33:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:11.513 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.513 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.513 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.513 21:33:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.513 21:33:05 -- nvmf/common.sh@717 -- # local ip 00:32:11.513 21:33:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.513 21:33:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.513 21:33:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.513 21:33:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.513 21:33:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.513 21:33:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.513 21:33:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.513 21:33:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.513 21:33:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.513 21:33:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:11.513 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.513 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.772 nvme0n1 00:32:11.772 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.772 21:33:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.772 21:33:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.772 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.772 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.772 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.772 21:33:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.772 21:33:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.772 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.772 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.772 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.772 21:33:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.772 21:33:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:32:11.772 21:33:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.772 21:33:05 -- host/auth.sh@44 -- # digest=sha512 00:32:11.772 21:33:05 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:11.772 21:33:05 -- host/auth.sh@44 -- # keyid=1 00:32:11.772 21:33:05 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:11.772 21:33:05 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:11.772 21:33:05 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:11.772 21:33:05 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:11.772 21:33:05 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:32:11.772 21:33:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.772 21:33:05 -- host/auth.sh@68 -- # digest=sha512 00:32:11.772 21:33:05 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:11.772 21:33:05 -- host/auth.sh@68 -- # keyid=1 00:32:11.772 21:33:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:11.772 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.772 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:11.772 21:33:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.772 21:33:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.772 21:33:05 -- nvmf/common.sh@717 -- # local ip 00:32:11.772 21:33:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.772 21:33:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.772 21:33:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.772 21:33:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.772 21:33:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.772 21:33:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.772 21:33:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.772 21:33:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.772 21:33:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.772 21:33:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:11.772 21:33:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.772 21:33:05 -- common/autotest_common.sh@10 -- # set +x 00:32:12.032 nvme0n1 00:32:12.032 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.032 21:33:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.032 21:33:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.032 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.032 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.032 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.032 21:33:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.032 21:33:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.032 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.032 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.032 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.032 21:33:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.032 21:33:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:32:12.032 21:33:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.032 21:33:06 -- host/auth.sh@44 -- # digest=sha512 00:32:12.032 21:33:06 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.032 21:33:06 -- host/auth.sh@44 -- # keyid=2 00:32:12.032 21:33:06 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:12.032 21:33:06 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:12.032 21:33:06 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.032 21:33:06 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:12.032 21:33:06 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:32:12.032 21:33:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.032 21:33:06 -- host/auth.sh@68 -- # digest=sha512 00:32:12.032 21:33:06 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.032 21:33:06 -- host/auth.sh@68 -- # keyid=2 00:32:12.032 21:33:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:12.032 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.032 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.032 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.032 21:33:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.032 21:33:06 -- nvmf/common.sh@717 -- # local ip 00:32:12.032 21:33:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.032 21:33:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.032 21:33:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.032 21:33:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.032 21:33:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.032 21:33:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.032 21:33:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.032 21:33:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.032 21:33:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.032 21:33:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:12.032 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.032 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.291 nvme0n1 00:32:12.291 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.291 21:33:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.291 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.291 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.291 21:33:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.291 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.291 21:33:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.291 21:33:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.291 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.291 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.291 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.291 21:33:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.291 21:33:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:32:12.291 21:33:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.291 21:33:06 -- host/auth.sh@44 -- # digest=sha512 00:32:12.291 21:33:06 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.291 21:33:06 -- host/auth.sh@44 -- # keyid=3 00:32:12.291 21:33:06 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:12.291 21:33:06 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:12.291 21:33:06 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.291 21:33:06 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:12.291 21:33:06 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:32:12.291 21:33:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.291 21:33:06 -- host/auth.sh@68 -- # digest=sha512 00:32:12.291 21:33:06 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.291 21:33:06 -- host/auth.sh@68 -- # keyid=3 00:32:12.291 21:33:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:12.291 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.291 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.291 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.291 21:33:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.291 21:33:06 -- nvmf/common.sh@717 -- # local ip 00:32:12.291 21:33:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.291 21:33:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.291 21:33:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.291 21:33:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.291 21:33:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.291 21:33:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.291 21:33:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.291 21:33:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.291 21:33:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.291 21:33:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:12.291 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.291 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.550 nvme0n1 00:32:12.550 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.550 21:33:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.550 21:33:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.550 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.550 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.550 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.550 21:33:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.550 21:33:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.550 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.550 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.550 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.550 21:33:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.550 21:33:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:32:12.550 21:33:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.550 21:33:06 -- host/auth.sh@44 -- # digest=sha512 00:32:12.550 21:33:06 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.550 21:33:06 -- host/auth.sh@44 -- # keyid=4 00:32:12.550 21:33:06 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:12.550 21:33:06 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:12.550 21:33:06 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.550 21:33:06 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:12.550 21:33:06 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:32:12.550 21:33:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.550 21:33:06 -- host/auth.sh@68 -- # digest=sha512 00:32:12.550 21:33:06 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.550 21:33:06 -- host/auth.sh@68 -- # keyid=4 00:32:12.550 21:33:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:12.550 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.550 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.550 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.550 21:33:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.550 21:33:06 -- nvmf/common.sh@717 -- # local ip 00:32:12.550 21:33:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.550 21:33:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.550 21:33:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.550 21:33:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.550 21:33:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.550 21:33:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.550 21:33:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.550 21:33:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.550 21:33:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.550 21:33:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:12.550 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.550 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.809 nvme0n1 00:32:12.809 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.809 21:33:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.809 21:33:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.809 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.809 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.809 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.809 21:33:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.809 21:33:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.809 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.809 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.809 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.809 21:33:06 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:12.809 21:33:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.809 21:33:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:32:12.809 21:33:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.809 21:33:06 -- host/auth.sh@44 -- # digest=sha512 00:32:12.809 21:33:06 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:12.809 21:33:06 -- host/auth.sh@44 -- # keyid=0 00:32:12.809 21:33:06 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:12.809 21:33:06 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:12.809 21:33:06 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:12.809 21:33:06 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:12.809 21:33:06 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:32:12.809 21:33:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.809 21:33:06 -- host/auth.sh@68 -- # digest=sha512 00:32:12.809 21:33:06 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:12.809 21:33:06 -- host/auth.sh@68 -- # keyid=0 00:32:12.809 21:33:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:12.809 21:33:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.809 21:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:12.809 21:33:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.809 21:33:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.809 21:33:07 -- nvmf/common.sh@717 -- # local ip 00:32:12.809 21:33:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.809 21:33:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.809 21:33:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.809 21:33:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.809 21:33:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.809 21:33:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.809 21:33:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.809 21:33:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.809 21:33:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.809 21:33:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:12.809 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.809 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.078 nvme0n1 00:32:13.078 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.078 21:33:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.078 21:33:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.078 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.078 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.078 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.078 21:33:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.078 21:33:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.078 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.078 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.078 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.078 21:33:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.078 21:33:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:32:13.078 21:33:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.078 21:33:07 -- host/auth.sh@44 -- # digest=sha512 00:32:13.078 21:33:07 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:13.078 21:33:07 -- host/auth.sh@44 -- # keyid=1 00:32:13.078 21:33:07 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:13.078 21:33:07 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:13.078 21:33:07 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:13.078 21:33:07 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:13.078 21:33:07 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:32:13.078 21:33:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.078 21:33:07 -- host/auth.sh@68 -- # digest=sha512 00:32:13.078 21:33:07 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:13.078 21:33:07 -- host/auth.sh@68 -- # keyid=1 00:32:13.078 21:33:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:13.078 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.078 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.078 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.078 21:33:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.078 21:33:07 -- nvmf/common.sh@717 -- # local ip 00:32:13.078 21:33:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.078 21:33:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.078 21:33:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.078 21:33:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.078 21:33:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.078 21:33:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.078 21:33:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.078 21:33:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.078 21:33:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.078 21:33:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:13.079 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.079 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.340 nvme0n1 00:32:13.340 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.340 21:33:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.340 21:33:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.340 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.340 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.340 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.340 21:33:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.340 21:33:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.340 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.340 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.599 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.599 21:33:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.599 21:33:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:32:13.599 21:33:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.599 21:33:07 -- host/auth.sh@44 -- # digest=sha512 00:32:13.599 21:33:07 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:13.599 21:33:07 -- host/auth.sh@44 -- # keyid=2 00:32:13.599 21:33:07 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:13.599 21:33:07 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:13.599 21:33:07 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:13.599 21:33:07 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:13.599 21:33:07 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:32:13.599 21:33:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.599 21:33:07 -- host/auth.sh@68 -- # digest=sha512 00:32:13.599 21:33:07 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:13.599 21:33:07 -- host/auth.sh@68 -- # keyid=2 00:32:13.599 21:33:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:13.599 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.599 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.599 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.599 21:33:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.599 21:33:07 -- nvmf/common.sh@717 -- # local ip 00:32:13.599 21:33:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.599 21:33:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.599 21:33:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.599 21:33:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.599 21:33:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.599 21:33:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.599 21:33:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.599 21:33:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.599 21:33:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.599 21:33:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:13.599 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.599 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.599 nvme0n1 00:32:13.599 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.599 21:33:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.599 21:33:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.599 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.599 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.858 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.858 21:33:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.858 21:33:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.858 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.858 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.858 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.858 21:33:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.858 21:33:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:32:13.858 21:33:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.858 21:33:07 -- host/auth.sh@44 -- # digest=sha512 00:32:13.858 21:33:07 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:13.858 21:33:07 -- host/auth.sh@44 -- # keyid=3 00:32:13.858 21:33:07 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:13.858 21:33:07 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:13.858 21:33:07 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:13.858 21:33:07 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:13.858 21:33:07 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:32:13.858 21:33:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.858 21:33:07 -- host/auth.sh@68 -- # digest=sha512 00:32:13.858 21:33:07 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:13.858 21:33:07 -- host/auth.sh@68 -- # keyid=3 00:32:13.858 21:33:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:13.858 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.858 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:13.858 21:33:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.858 21:33:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.858 21:33:07 -- nvmf/common.sh@717 -- # local ip 00:32:13.858 21:33:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.858 21:33:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.858 21:33:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.858 21:33:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.858 21:33:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.858 21:33:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.858 21:33:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.858 21:33:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.858 21:33:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.858 21:33:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:13.858 21:33:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.858 21:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:14.117 nvme0n1 00:32:14.117 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.117 21:33:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.117 21:33:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.117 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.117 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.117 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.117 21:33:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.117 21:33:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.117 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.117 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.117 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.117 21:33:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.117 21:33:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:32:14.117 21:33:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.117 21:33:08 -- host/auth.sh@44 -- # digest=sha512 00:32:14.117 21:33:08 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:14.117 21:33:08 -- host/auth.sh@44 -- # keyid=4 00:32:14.117 21:33:08 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:14.117 21:33:08 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:14.117 21:33:08 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:14.117 21:33:08 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:14.117 21:33:08 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:32:14.117 21:33:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.117 21:33:08 -- host/auth.sh@68 -- # digest=sha512 00:32:14.117 21:33:08 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:14.117 21:33:08 -- host/auth.sh@68 -- # keyid=4 00:32:14.117 21:33:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:14.117 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.117 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.117 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.117 21:33:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.117 21:33:08 -- nvmf/common.sh@717 -- # local ip 00:32:14.117 21:33:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.117 21:33:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.117 21:33:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.117 21:33:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.117 21:33:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.117 21:33:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.117 21:33:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.117 21:33:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.117 21:33:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.117 21:33:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:14.117 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.117 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.376 nvme0n1 00:32:14.376 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.376 21:33:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.376 21:33:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.376 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.376 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.376 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.376 21:33:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.376 21:33:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.376 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.376 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.376 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.376 21:33:08 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:14.376 21:33:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.376 21:33:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:32:14.376 21:33:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.376 21:33:08 -- host/auth.sh@44 -- # digest=sha512 00:32:14.376 21:33:08 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:14.376 21:33:08 -- host/auth.sh@44 -- # keyid=0 00:32:14.376 21:33:08 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:14.376 21:33:08 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:14.376 21:33:08 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:14.376 21:33:08 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:14.376 21:33:08 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:32:14.376 21:33:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.376 21:33:08 -- host/auth.sh@68 -- # digest=sha512 00:32:14.376 21:33:08 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:14.376 21:33:08 -- host/auth.sh@68 -- # keyid=0 00:32:14.376 21:33:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:14.376 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.376 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.376 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.376 21:33:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.376 21:33:08 -- nvmf/common.sh@717 -- # local ip 00:32:14.376 21:33:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.376 21:33:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.376 21:33:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.376 21:33:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.376 21:33:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.376 21:33:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.376 21:33:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.376 21:33:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.376 21:33:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.376 21:33:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:14.376 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.376 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.943 nvme0n1 00:32:14.943 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.943 21:33:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.943 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.944 21:33:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.944 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.944 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.944 21:33:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.944 21:33:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.944 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.944 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.944 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.944 21:33:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.944 21:33:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:32:14.944 21:33:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.944 21:33:08 -- host/auth.sh@44 -- # digest=sha512 00:32:14.944 21:33:08 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:14.944 21:33:08 -- host/auth.sh@44 -- # keyid=1 00:32:14.944 21:33:08 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:14.944 21:33:08 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:14.944 21:33:08 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:14.944 21:33:08 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:14.944 21:33:08 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:32:14.944 21:33:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.944 21:33:08 -- host/auth.sh@68 -- # digest=sha512 00:32:14.944 21:33:08 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:14.944 21:33:08 -- host/auth.sh@68 -- # keyid=1 00:32:14.944 21:33:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:14.944 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.944 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:14.944 21:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.944 21:33:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.944 21:33:08 -- nvmf/common.sh@717 -- # local ip 00:32:14.944 21:33:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.944 21:33:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.944 21:33:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.944 21:33:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.944 21:33:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.944 21:33:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.944 21:33:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.944 21:33:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.944 21:33:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.944 21:33:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:14.944 21:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.944 21:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:15.203 nvme0n1 00:32:15.203 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.203 21:33:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.203 21:33:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.203 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.203 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.203 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.203 21:33:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.203 21:33:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.203 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.203 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.203 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.203 21:33:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.203 21:33:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:32:15.203 21:33:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.203 21:33:09 -- host/auth.sh@44 -- # digest=sha512 00:32:15.203 21:33:09 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:15.203 21:33:09 -- host/auth.sh@44 -- # keyid=2 00:32:15.203 21:33:09 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:15.203 21:33:09 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:15.203 21:33:09 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:15.203 21:33:09 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:15.203 21:33:09 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:32:15.203 21:33:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.203 21:33:09 -- host/auth.sh@68 -- # digest=sha512 00:32:15.203 21:33:09 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:15.203 21:33:09 -- host/auth.sh@68 -- # keyid=2 00:32:15.203 21:33:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:15.203 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.203 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.203 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.203 21:33:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.203 21:33:09 -- nvmf/common.sh@717 -- # local ip 00:32:15.203 21:33:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.203 21:33:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.203 21:33:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.203 21:33:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.203 21:33:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.203 21:33:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.203 21:33:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.203 21:33:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.203 21:33:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.203 21:33:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:15.203 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.203 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.771 nvme0n1 00:32:15.771 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.771 21:33:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.771 21:33:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.771 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.771 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.771 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.771 21:33:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.771 21:33:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.771 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.771 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.771 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.771 21:33:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.771 21:33:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:32:15.771 21:33:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.771 21:33:09 -- host/auth.sh@44 -- # digest=sha512 00:32:15.771 21:33:09 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:15.771 21:33:09 -- host/auth.sh@44 -- # keyid=3 00:32:15.771 21:33:09 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:15.771 21:33:09 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:15.771 21:33:09 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:15.771 21:33:09 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:15.771 21:33:09 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:32:15.771 21:33:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.771 21:33:09 -- host/auth.sh@68 -- # digest=sha512 00:32:15.771 21:33:09 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:15.771 21:33:09 -- host/auth.sh@68 -- # keyid=3 00:32:15.771 21:33:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:15.771 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.771 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:15.771 21:33:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.771 21:33:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.771 21:33:09 -- nvmf/common.sh@717 -- # local ip 00:32:15.771 21:33:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.771 21:33:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.771 21:33:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.771 21:33:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.771 21:33:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.771 21:33:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.771 21:33:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.771 21:33:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.771 21:33:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.771 21:33:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:15.771 21:33:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.771 21:33:09 -- common/autotest_common.sh@10 -- # set +x 00:32:16.030 nvme0n1 00:32:16.030 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.030 21:33:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:16.030 21:33:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:16.030 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.030 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.030 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.030 21:33:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:16.030 21:33:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:16.030 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.030 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.030 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.030 21:33:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:16.030 21:33:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:32:16.030 21:33:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:16.030 21:33:10 -- host/auth.sh@44 -- # digest=sha512 00:32:16.030 21:33:10 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:16.030 21:33:10 -- host/auth.sh@44 -- # keyid=4 00:32:16.030 21:33:10 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:16.030 21:33:10 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:16.030 21:33:10 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:16.030 21:33:10 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:16.030 21:33:10 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:32:16.030 21:33:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:16.030 21:33:10 -- host/auth.sh@68 -- # digest=sha512 00:32:16.030 21:33:10 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:16.030 21:33:10 -- host/auth.sh@68 -- # keyid=4 00:32:16.030 21:33:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:16.030 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.030 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.030 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.030 21:33:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:16.030 21:33:10 -- nvmf/common.sh@717 -- # local ip 00:32:16.030 21:33:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:16.030 21:33:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:16.030 21:33:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:16.030 21:33:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:16.030 21:33:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:16.030 21:33:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:16.030 21:33:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:16.030 21:33:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:16.030 21:33:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:16.030 21:33:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:16.031 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.031 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.598 nvme0n1 00:32:16.598 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.598 21:33:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:16.598 21:33:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:16.598 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.598 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.598 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.598 21:33:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:16.598 21:33:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:16.598 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.598 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.598 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.598 21:33:10 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:16.598 21:33:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:16.598 21:33:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:32:16.598 21:33:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:16.598 21:33:10 -- host/auth.sh@44 -- # digest=sha512 00:32:16.598 21:33:10 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:16.598 21:33:10 -- host/auth.sh@44 -- # keyid=0 00:32:16.598 21:33:10 -- host/auth.sh@45 -- # key=DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:16.598 21:33:10 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:16.598 21:33:10 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:16.598 21:33:10 -- host/auth.sh@49 -- # echo DHHC-1:00:MTlmOTc3Nzk2Yzk5OGUzMmZmY2I0OTI3YTYyYWM2ZWOjJO3R: 00:32:16.598 21:33:10 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:32:16.598 21:33:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:16.598 21:33:10 -- host/auth.sh@68 -- # digest=sha512 00:32:16.598 21:33:10 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:16.598 21:33:10 -- host/auth.sh@68 -- # keyid=0 00:32:16.598 21:33:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:16.598 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.598 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:16.598 21:33:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.598 21:33:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:16.598 21:33:10 -- nvmf/common.sh@717 -- # local ip 00:32:16.599 21:33:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:16.599 21:33:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:16.599 21:33:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:16.599 21:33:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:16.599 21:33:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:16.599 21:33:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:16.599 21:33:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:16.599 21:33:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:16.599 21:33:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:16.599 21:33:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:16.599 21:33:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.599 21:33:10 -- common/autotest_common.sh@10 -- # set +x 00:32:17.166 nvme0n1 00:32:17.166 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.166 21:33:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:17.166 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.166 21:33:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:17.166 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.166 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.166 21:33:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:17.166 21:33:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:17.166 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.166 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.166 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.166 21:33:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:17.166 21:33:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:32:17.166 21:33:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:17.166 21:33:11 -- host/auth.sh@44 -- # digest=sha512 00:32:17.166 21:33:11 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:17.166 21:33:11 -- host/auth.sh@44 -- # keyid=1 00:32:17.166 21:33:11 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:17.166 21:33:11 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:17.166 21:33:11 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:17.166 21:33:11 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:17.166 21:33:11 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:32:17.166 21:33:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.166 21:33:11 -- host/auth.sh@68 -- # digest=sha512 00:32:17.166 21:33:11 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:17.166 21:33:11 -- host/auth.sh@68 -- # keyid=1 00:32:17.166 21:33:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:17.166 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.167 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.167 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.167 21:33:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.167 21:33:11 -- nvmf/common.sh@717 -- # local ip 00:32:17.167 21:33:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.167 21:33:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.167 21:33:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.167 21:33:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.167 21:33:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.167 21:33:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.167 21:33:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.167 21:33:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.167 21:33:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.167 21:33:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:17.167 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.167 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.735 nvme0n1 00:32:17.735 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.735 21:33:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:17.735 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.735 21:33:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:17.735 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.735 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.735 21:33:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:17.735 21:33:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:17.735 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.735 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.735 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.735 21:33:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:17.735 21:33:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:32:17.735 21:33:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:17.735 21:33:11 -- host/auth.sh@44 -- # digest=sha512 00:32:17.735 21:33:11 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:17.735 21:33:11 -- host/auth.sh@44 -- # keyid=2 00:32:17.735 21:33:11 -- host/auth.sh@45 -- # key=DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:17.735 21:33:11 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:17.735 21:33:11 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:17.735 21:33:11 -- host/auth.sh@49 -- # echo DHHC-1:01:MDc0ZGQ0OWI2OWM5NDU2N2U2NzAzYzgyNWY1NjY5MDnPXkJB: 00:32:17.735 21:33:11 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:32:17.735 21:33:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.735 21:33:11 -- host/auth.sh@68 -- # digest=sha512 00:32:17.735 21:33:11 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:17.735 21:33:11 -- host/auth.sh@68 -- # keyid=2 00:32:17.735 21:33:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:17.735 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.735 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:17.735 21:33:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.735 21:33:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.735 21:33:11 -- nvmf/common.sh@717 -- # local ip 00:32:17.735 21:33:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.735 21:33:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.735 21:33:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.735 21:33:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.735 21:33:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.735 21:33:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.735 21:33:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.735 21:33:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.735 21:33:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.735 21:33:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:17.735 21:33:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.735 21:33:11 -- common/autotest_common.sh@10 -- # set +x 00:32:18.303 nvme0n1 00:32:18.303 21:33:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.303 21:33:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.303 21:33:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.303 21:33:12 -- common/autotest_common.sh@10 -- # set +x 00:32:18.303 21:33:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.303 21:33:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.303 21:33:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.303 21:33:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.303 21:33:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.303 21:33:12 -- common/autotest_common.sh@10 -- # set +x 00:32:18.303 21:33:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.303 21:33:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.303 21:33:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:32:18.303 21:33:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.303 21:33:12 -- host/auth.sh@44 -- # digest=sha512 00:32:18.303 21:33:12 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:18.303 21:33:12 -- host/auth.sh@44 -- # keyid=3 00:32:18.303 21:33:12 -- host/auth.sh@45 -- # key=DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:18.303 21:33:12 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:18.303 21:33:12 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:18.303 21:33:12 -- host/auth.sh@49 -- # echo DHHC-1:02:MDE5MTlhMjJjNGI0NmYzODM3YTg1YjIxMDRiOTg0MzI5NGZiNzY5Mzg0ZDI2MjgytIIP/w==: 00:32:18.303 21:33:12 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:32:18.303 21:33:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.303 21:33:12 -- host/auth.sh@68 -- # digest=sha512 00:32:18.303 21:33:12 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:18.303 21:33:12 -- host/auth.sh@68 -- # keyid=3 00:32:18.303 21:33:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:18.303 21:33:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.303 21:33:12 -- common/autotest_common.sh@10 -- # set +x 00:32:18.303 21:33:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.303 21:33:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.303 21:33:12 -- nvmf/common.sh@717 -- # local ip 00:32:18.303 21:33:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.303 21:33:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.303 21:33:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.303 21:33:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.303 21:33:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.303 21:33:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.303 21:33:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.303 21:33:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.303 21:33:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.303 21:33:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:18.303 21:33:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.303 21:33:12 -- common/autotest_common.sh@10 -- # set +x 00:32:18.869 nvme0n1 00:32:18.869 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.869 21:33:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.869 21:33:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.869 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.869 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:18.869 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.869 21:33:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.869 21:33:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.869 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.869 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:18.869 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.869 21:33:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.869 21:33:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:32:18.869 21:33:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.869 21:33:13 -- host/auth.sh@44 -- # digest=sha512 00:32:18.869 21:33:13 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:18.869 21:33:13 -- host/auth.sh@44 -- # keyid=4 00:32:18.869 21:33:13 -- host/auth.sh@45 -- # key=DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:18.869 21:33:13 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:18.869 21:33:13 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:18.869 21:33:13 -- host/auth.sh@49 -- # echo DHHC-1:03:MDA1YTllZjMzMmJhOTk2ZWVmYjQzOTMyOTViOWM1NTRiNDRiYjA2YTk0N2Q0YmE0NmUwNGE0YzZjZmUyMzc4YZpyfV8=: 00:32:18.869 21:33:13 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:32:18.869 21:33:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.869 21:33:13 -- host/auth.sh@68 -- # digest=sha512 00:32:18.869 21:33:13 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:18.869 21:33:13 -- host/auth.sh@68 -- # keyid=4 00:32:18.869 21:33:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:18.869 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.869 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:18.869 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.869 21:33:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.869 21:33:13 -- nvmf/common.sh@717 -- # local ip 00:32:18.869 21:33:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.869 21:33:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.869 21:33:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.869 21:33:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.869 21:33:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.869 21:33:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.869 21:33:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.869 21:33:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.869 21:33:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.869 21:33:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:18.869 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.869 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.435 nvme0n1 00:32:19.435 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.435 21:33:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:19.435 21:33:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:19.435 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.435 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.435 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.435 21:33:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:19.436 21:33:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:19.436 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.436 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.436 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.436 21:33:13 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:19.436 21:33:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:19.436 21:33:13 -- host/auth.sh@44 -- # digest=sha256 00:32:19.436 21:33:13 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:19.436 21:33:13 -- host/auth.sh@44 -- # keyid=1 00:32:19.436 21:33:13 -- host/auth.sh@45 -- # key=DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:19.436 21:33:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:19.436 21:33:13 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:19.436 21:33:13 -- host/auth.sh@49 -- # echo DHHC-1:00:NGQ5MGU3YjhiNjcxZDJkMDQxZDVkMmEwODg4NjA3ZDgyNzIzNTQyZmY4OGU5ZGFjGg7biA==: 00:32:19.436 21:33:13 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:19.436 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.436 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.436 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.436 21:33:13 -- host/auth.sh@119 -- # get_main_ns_ip 00:32:19.436 21:33:13 -- nvmf/common.sh@717 -- # local ip 00:32:19.436 21:33:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:19.436 21:33:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:19.436 21:33:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:19.436 21:33:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:19.436 21:33:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:19.436 21:33:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:19.436 21:33:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:19.436 21:33:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:19.436 21:33:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:19.436 21:33:13 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:19.436 21:33:13 -- common/autotest_common.sh@638 -- # local es=0 00:32:19.436 21:33:13 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:19.436 21:33:13 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:19.436 21:33:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:19.436 21:33:13 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:19.436 21:33:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:19.436 21:33:13 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:19.436 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.436 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.694 request: 00:32:19.694 { 00:32:19.694 "name": "nvme0", 00:32:19.694 "trtype": "rdma", 00:32:19.694 "traddr": "192.168.100.8", 00:32:19.694 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:19.694 "adrfam": "ipv4", 00:32:19.694 "trsvcid": "4420", 00:32:19.694 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:19.694 "method": "bdev_nvme_attach_controller", 00:32:19.694 "req_id": 1 00:32:19.694 } 00:32:19.694 Got JSON-RPC error response 00:32:19.694 response: 00:32:19.694 { 00:32:19.694 "code": -32602, 00:32:19.694 "message": "Invalid parameters" 00:32:19.694 } 00:32:19.694 21:33:13 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:19.694 21:33:13 -- common/autotest_common.sh@641 -- # es=1 00:32:19.694 21:33:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:19.694 21:33:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:19.694 21:33:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:19.694 21:33:13 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:32:19.694 21:33:13 -- host/auth.sh@121 -- # jq length 00:32:19.694 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.694 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.694 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.694 21:33:13 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:32:19.694 21:33:13 -- host/auth.sh@124 -- # get_main_ns_ip 00:32:19.694 21:33:13 -- nvmf/common.sh@717 -- # local ip 00:32:19.694 21:33:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:19.694 21:33:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:19.694 21:33:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:19.694 21:33:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:19.694 21:33:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:19.694 21:33:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:19.694 21:33:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:19.694 21:33:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:19.694 21:33:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:19.694 21:33:13 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:19.694 21:33:13 -- common/autotest_common.sh@638 -- # local es=0 00:32:19.694 21:33:13 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:19.695 21:33:13 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:19.695 21:33:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:19.695 21:33:13 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:19.695 21:33:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:19.695 21:33:13 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:19.695 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.695 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.695 request: 00:32:19.695 { 00:32:19.695 "name": "nvme0", 00:32:19.695 "trtype": "rdma", 00:32:19.695 "traddr": "192.168.100.8", 00:32:19.695 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:19.695 "adrfam": "ipv4", 00:32:19.695 "trsvcid": "4420", 00:32:19.695 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:19.695 "dhchap_key": "key2", 00:32:19.695 "method": "bdev_nvme_attach_controller", 00:32:19.695 "req_id": 1 00:32:19.695 } 00:32:19.695 Got JSON-RPC error response 00:32:19.695 response: 00:32:19.695 { 00:32:19.695 "code": -32602, 00:32:19.695 "message": "Invalid parameters" 00:32:19.695 } 00:32:19.695 21:33:13 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:19.695 21:33:13 -- common/autotest_common.sh@641 -- # es=1 00:32:19.695 21:33:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:19.695 21:33:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:19.695 21:33:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:19.695 21:33:13 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:32:19.695 21:33:13 -- host/auth.sh@127 -- # jq length 00:32:19.695 21:33:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.695 21:33:13 -- common/autotest_common.sh@10 -- # set +x 00:32:19.695 21:33:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.695 21:33:13 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:32:19.695 21:33:13 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:32:19.695 21:33:13 -- host/auth.sh@130 -- # cleanup 00:32:19.695 21:33:13 -- host/auth.sh@24 -- # nvmftestfini 00:32:19.695 21:33:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:19.695 21:33:13 -- nvmf/common.sh@117 -- # sync 00:32:19.953 21:33:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:32:19.953 21:33:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:32:19.953 21:33:13 -- nvmf/common.sh@120 -- # set +e 00:32:19.953 21:33:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:19.953 21:33:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:32:19.953 rmmod nvme_rdma 00:32:19.953 rmmod nvme_fabrics 00:32:19.953 21:33:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:19.953 21:33:14 -- nvmf/common.sh@124 -- # set -e 00:32:19.953 21:33:14 -- nvmf/common.sh@125 -- # return 0 00:32:19.953 21:33:14 -- nvmf/common.sh@478 -- # '[' -n 1554060 ']' 00:32:19.953 21:33:14 -- nvmf/common.sh@479 -- # killprocess 1554060 00:32:19.953 21:33:14 -- common/autotest_common.sh@936 -- # '[' -z 1554060 ']' 00:32:19.953 21:33:14 -- common/autotest_common.sh@940 -- # kill -0 1554060 00:32:19.953 21:33:14 -- common/autotest_common.sh@941 -- # uname 00:32:19.953 21:33:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:19.953 21:33:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1554060 00:32:19.953 21:33:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:19.953 21:33:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:19.953 21:33:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1554060' 00:32:19.953 killing process with pid 1554060 00:32:19.953 21:33:14 -- common/autotest_common.sh@955 -- # kill 1554060 00:32:19.953 21:33:14 -- common/autotest_common.sh@960 -- # wait 1554060 00:32:20.212 21:33:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:32:20.212 21:33:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:32:20.212 21:33:14 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:32:20.212 21:33:14 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:32:20.212 21:33:14 -- host/auth.sh@27 -- # clean_kernel_target 00:32:20.212 21:33:14 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:32:20.212 21:33:14 -- nvmf/common.sh@675 -- # echo 0 00:32:20.212 21:33:14 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:20.212 21:33:14 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:20.212 21:33:14 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:20.212 21:33:14 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:20.212 21:33:14 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:32:20.212 21:33:14 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:32:20.212 21:33:14 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:32:22.744 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:22.744 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:26.029 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:32:26.964 21:33:21 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.b4c /tmp/spdk.key-null.poc /tmp/spdk.key-sha256.ORB /tmp/spdk.key-sha384.t7b /tmp/spdk.key-sha512.G9e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:32:26.964 21:33:21 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:32:29.558 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:32:29.558 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:32:29.817 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:32:31.192 00:32:31.192 real 0m52.215s 00:32:31.192 user 0m39.594s 00:32:31.192 sys 0m13.629s 00:32:31.192 21:33:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:31.192 21:33:25 -- common/autotest_common.sh@10 -- # set +x 00:32:31.192 ************************************ 00:32:31.192 END TEST nvmf_auth 00:32:31.192 ************************************ 00:32:31.192 21:33:25 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:32:31.192 21:33:25 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:32:31.192 21:33:25 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:32:31.192 21:33:25 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:32:31.192 21:33:25 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:31.192 21:33:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:31.192 21:33:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:31.192 21:33:25 -- common/autotest_common.sh@10 -- # set +x 00:32:31.192 ************************************ 00:32:31.192 START TEST nvmf_bdevperf 00:32:31.192 ************************************ 00:32:31.192 21:33:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:31.192 * Looking for test storage... 00:32:31.192 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:32:31.192 21:33:25 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:32:31.192 21:33:25 -- nvmf/common.sh@7 -- # uname -s 00:32:31.192 21:33:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:31.192 21:33:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:31.192 21:33:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:31.192 21:33:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:31.192 21:33:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:31.192 21:33:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:31.192 21:33:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:31.192 21:33:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:31.192 21:33:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:31.192 21:33:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:31.192 21:33:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:32:31.192 21:33:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:32:31.192 21:33:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:31.192 21:33:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:31.192 21:33:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:31.192 21:33:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:31.192 21:33:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:32:31.192 21:33:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:31.192 21:33:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:31.192 21:33:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:31.192 21:33:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.192 21:33:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.193 21:33:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.193 21:33:25 -- paths/export.sh@5 -- # export PATH 00:32:31.193 21:33:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.193 21:33:25 -- nvmf/common.sh@47 -- # : 0 00:32:31.193 21:33:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:31.193 21:33:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:31.193 21:33:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:31.193 21:33:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:31.193 21:33:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:31.193 21:33:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:31.193 21:33:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:31.193 21:33:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:31.193 21:33:25 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:32:31.193 21:33:25 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:32:31.193 21:33:25 -- host/bdevperf.sh@24 -- # nvmftestinit 00:32:31.193 21:33:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:32:31.193 21:33:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:31.193 21:33:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:32:31.193 21:33:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:32:31.193 21:33:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:32:31.193 21:33:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:31.193 21:33:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:31.193 21:33:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:31.193 21:33:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:32:31.193 21:33:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:32:31.193 21:33:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:32:31.193 21:33:25 -- common/autotest_common.sh@10 -- # set +x 00:32:36.466 21:33:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:36.466 21:33:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:32:36.466 21:33:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:32:36.466 21:33:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:32:36.466 21:33:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:32:36.466 21:33:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:32:36.466 21:33:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:32:36.466 21:33:30 -- nvmf/common.sh@295 -- # net_devs=() 00:32:36.466 21:33:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:32:36.466 21:33:30 -- nvmf/common.sh@296 -- # e810=() 00:32:36.466 21:33:30 -- nvmf/common.sh@296 -- # local -ga e810 00:32:36.466 21:33:30 -- nvmf/common.sh@297 -- # x722=() 00:32:36.466 21:33:30 -- nvmf/common.sh@297 -- # local -ga x722 00:32:36.466 21:33:30 -- nvmf/common.sh@298 -- # mlx=() 00:32:36.466 21:33:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:32:36.466 21:33:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:36.466 21:33:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:32:36.466 21:33:30 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:32:36.466 21:33:30 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:32:36.466 21:33:30 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:32:36.466 21:33:30 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:32:36.467 21:33:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:32:36.467 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:32:36.467 21:33:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:36.467 21:33:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:32:36.467 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:32:36.467 21:33:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:36.467 21:33:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.467 21:33:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.467 21:33:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:32:36.467 Found net devices under 0000:18:00.0: mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.467 21:33:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.467 21:33:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.467 21:33:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:32:36.467 Found net devices under 0000:18:00.1: mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.467 21:33:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:32:36.467 21:33:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@409 -- # rdma_device_init 00:32:36.467 21:33:30 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:32:36.467 21:33:30 -- nvmf/common.sh@58 -- # uname 00:32:36.467 21:33:30 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:32:36.467 21:33:30 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:32:36.467 21:33:30 -- nvmf/common.sh@63 -- # modprobe ib_core 00:32:36.467 21:33:30 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:32:36.467 21:33:30 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:32:36.467 21:33:30 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:32:36.467 21:33:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:32:36.467 21:33:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:32:36.467 21:33:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:32:36.467 21:33:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:32:36.467 21:33:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:32:36.467 21:33:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:36.467 21:33:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:36.467 21:33:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:36.467 21:33:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:36.467 21:33:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@105 -- # continue 2 00:32:36.467 21:33:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@105 -- # continue 2 00:32:36.467 21:33:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:36.467 21:33:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:36.467 21:33:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:32:36.467 21:33:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:32:36.467 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:32:36.467 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:32:36.467 altname enp24s0f0np0 00:32:36.467 altname ens785f0np0 00:32:36.467 inet 192.168.100.8/24 scope global mlx_0_0 00:32:36.467 valid_lft forever preferred_lft forever 00:32:36.467 21:33:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:36.467 21:33:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:36.467 21:33:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:32:36.467 21:33:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:32:36.467 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:32:36.467 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:32:36.467 altname enp24s0f1np1 00:32:36.467 altname ens785f1np1 00:32:36.467 inet 192.168.100.9/24 scope global mlx_0_1 00:32:36.467 valid_lft forever preferred_lft forever 00:32:36.467 21:33:30 -- nvmf/common.sh@411 -- # return 0 00:32:36.467 21:33:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:32:36.467 21:33:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:32:36.467 21:33:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:32:36.467 21:33:30 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:32:36.467 21:33:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:36.467 21:33:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:36.467 21:33:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:36.467 21:33:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:36.467 21:33:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:36.467 21:33:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@105 -- # continue 2 00:32:36.467 21:33:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:36.467 21:33:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:32:36.467 21:33:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@105 -- # continue 2 00:32:36.467 21:33:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:36.467 21:33:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:36.467 21:33:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:36.467 21:33:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:36.467 21:33:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:36.467 21:33:30 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:32:36.467 192.168.100.9' 00:32:36.467 21:33:30 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:32:36.467 192.168.100.9' 00:32:36.467 21:33:30 -- nvmf/common.sh@446 -- # head -n 1 00:32:36.467 21:33:30 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:32:36.467 21:33:30 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:32:36.467 192.168.100.9' 00:32:36.467 21:33:30 -- nvmf/common.sh@447 -- # tail -n +2 00:32:36.467 21:33:30 -- nvmf/common.sh@447 -- # head -n 1 00:32:36.467 21:33:30 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:32:36.467 21:33:30 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:32:36.467 21:33:30 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:32:36.467 21:33:30 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:32:36.467 21:33:30 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:32:36.467 21:33:30 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:32:36.726 21:33:30 -- host/bdevperf.sh@25 -- # tgt_init 00:32:36.726 21:33:30 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:32:36.726 21:33:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:32:36.726 21:33:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:32:36.726 21:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:36.726 21:33:30 -- nvmf/common.sh@470 -- # nvmfpid=1572879 00:32:36.726 21:33:30 -- nvmf/common.sh@471 -- # waitforlisten 1572879 00:32:36.726 21:33:30 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:32:36.726 21:33:30 -- common/autotest_common.sh@817 -- # '[' -z 1572879 ']' 00:32:36.726 21:33:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:36.726 21:33:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:36.726 21:33:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:36.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:36.726 21:33:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:36.726 21:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:36.726 [2024-04-23 21:33:30.794251] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:32:36.726 [2024-04-23 21:33:30.794309] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:36.727 EAL: No free 2048 kB hugepages reported on node 1 00:32:36.727 [2024-04-23 21:33:30.844291] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:32:36.727 [2024-04-23 21:33:30.916549] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:36.727 [2024-04-23 21:33:30.916581] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:36.727 [2024-04-23 21:33:30.916588] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:32:36.727 [2024-04-23 21:33:30.916593] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:32:36.727 [2024-04-23 21:33:30.916600] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:36.727 [2024-04-23 21:33:30.916692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:36.727 [2024-04-23 21:33:30.916778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:36.727 [2024-04-23 21:33:30.916779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:37.663 21:33:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:37.663 21:33:31 -- common/autotest_common.sh@850 -- # return 0 00:32:37.663 21:33:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:32:37.663 21:33:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 21:33:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:37.663 21:33:31 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:32:37.663 21:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 [2024-04-23 21:33:31.631082] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bc0ed0/0x1bc53c0) succeed. 00:32:37.663 [2024-04-23 21:33:31.640143] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bc2470/0x1c06a50) succeed. 00:32:37.663 21:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.663 21:33:31 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:32:37.663 21:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 Malloc0 00:32:37.663 21:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.663 21:33:31 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:32:37.663 21:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 21:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.663 21:33:31 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:32:37.663 21:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 21:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.663 21:33:31 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:32:37.663 21:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.663 21:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:37.663 [2024-04-23 21:33:31.779004] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:32:37.663 21:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.663 21:33:31 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:32:37.663 21:33:31 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:32:37.663 21:33:31 -- nvmf/common.sh@521 -- # config=() 00:32:37.663 21:33:31 -- nvmf/common.sh@521 -- # local subsystem config 00:32:37.663 21:33:31 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:32:37.663 21:33:31 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:32:37.663 { 00:32:37.663 "params": { 00:32:37.663 "name": "Nvme$subsystem", 00:32:37.663 "trtype": "$TEST_TRANSPORT", 00:32:37.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:37.663 "adrfam": "ipv4", 00:32:37.663 "trsvcid": "$NVMF_PORT", 00:32:37.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:37.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:37.663 "hdgst": ${hdgst:-false}, 00:32:37.663 "ddgst": ${ddgst:-false} 00:32:37.663 }, 00:32:37.663 "method": "bdev_nvme_attach_controller" 00:32:37.663 } 00:32:37.663 EOF 00:32:37.663 )") 00:32:37.663 21:33:31 -- nvmf/common.sh@543 -- # cat 00:32:37.663 21:33:31 -- nvmf/common.sh@545 -- # jq . 00:32:37.663 21:33:31 -- nvmf/common.sh@546 -- # IFS=, 00:32:37.663 21:33:31 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:32:37.663 "params": { 00:32:37.663 "name": "Nvme1", 00:32:37.663 "trtype": "rdma", 00:32:37.663 "traddr": "192.168.100.8", 00:32:37.663 "adrfam": "ipv4", 00:32:37.663 "trsvcid": "4420", 00:32:37.663 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:37.663 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:37.663 "hdgst": false, 00:32:37.663 "ddgst": false 00:32:37.663 }, 00:32:37.663 "method": "bdev_nvme_attach_controller" 00:32:37.663 }' 00:32:37.663 [2024-04-23 21:33:31.828172] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:32:37.663 [2024-04-23 21:33:31.828213] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1573204 ] 00:32:37.663 EAL: No free 2048 kB hugepages reported on node 1 00:32:37.663 [2024-04-23 21:33:31.876758] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:37.922 [2024-04-23 21:33:31.942671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:37.922 Running I/O for 1 seconds... 00:32:38.858 00:32:38.858 Latency(us) 00:32:38.858 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:38.858 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:32:38.858 Verification LBA range: start 0x0 length 0x4000 00:32:38.858 Nvme1n1 : 1.00 19806.95 77.37 0.00 0.00 6423.13 1280.38 11602.30 00:32:38.858 =================================================================================================================== 00:32:38.858 Total : 19806.95 77.37 0.00 0.00 6423.13 1280.38 11602.30 00:32:39.117 21:33:33 -- host/bdevperf.sh@30 -- # bdevperfpid=1573697 00:32:39.118 21:33:33 -- host/bdevperf.sh@32 -- # sleep 3 00:32:39.118 21:33:33 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:32:39.118 21:33:33 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:32:39.118 21:33:33 -- nvmf/common.sh@521 -- # config=() 00:32:39.118 21:33:33 -- nvmf/common.sh@521 -- # local subsystem config 00:32:39.118 21:33:33 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:32:39.118 21:33:33 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:32:39.118 { 00:32:39.118 "params": { 00:32:39.118 "name": "Nvme$subsystem", 00:32:39.118 "trtype": "$TEST_TRANSPORT", 00:32:39.118 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:39.118 "adrfam": "ipv4", 00:32:39.118 "trsvcid": "$NVMF_PORT", 00:32:39.118 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:39.118 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:39.118 "hdgst": ${hdgst:-false}, 00:32:39.118 "ddgst": ${ddgst:-false} 00:32:39.118 }, 00:32:39.118 "method": "bdev_nvme_attach_controller" 00:32:39.118 } 00:32:39.118 EOF 00:32:39.118 )") 00:32:39.118 21:33:33 -- nvmf/common.sh@543 -- # cat 00:32:39.118 21:33:33 -- nvmf/common.sh@545 -- # jq . 00:32:39.118 21:33:33 -- nvmf/common.sh@546 -- # IFS=, 00:32:39.118 21:33:33 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:32:39.118 "params": { 00:32:39.118 "name": "Nvme1", 00:32:39.118 "trtype": "rdma", 00:32:39.118 "traddr": "192.168.100.8", 00:32:39.118 "adrfam": "ipv4", 00:32:39.118 "trsvcid": "4420", 00:32:39.118 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:39.118 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:39.118 "hdgst": false, 00:32:39.118 "ddgst": false 00:32:39.118 }, 00:32:39.118 "method": "bdev_nvme_attach_controller" 00:32:39.118 }' 00:32:39.118 [2024-04-23 21:33:33.382577] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:32:39.118 [2024-04-23 21:33:33.382617] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1573697 ] 00:32:39.377 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.377 [2024-04-23 21:33:33.432636] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:32:39.377 [2024-04-23 21:33:33.493980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:39.635 Running I/O for 15 seconds... 00:32:42.169 21:33:36 -- host/bdevperf.sh@33 -- # kill -9 1572879 00:32:42.169 21:33:36 -- host/bdevperf.sh@35 -- # sleep 3 00:32:43.108 [2024-04-23 21:33:37.370141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:33112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:33120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:33128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:33160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:33168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:33176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:33192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:33200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:33216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:33232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:33248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:33272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:33280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:33304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:33312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:33328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.108 [2024-04-23 21:33:37.370584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.108 [2024-04-23 21:33:37.370591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:33352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:33360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:33368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:33376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:33384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:33392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:33400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:33416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:33424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:33448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:33456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:33464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:33480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:33488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:33496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:33504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:33512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:33520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:33528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:33536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:33544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:33592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.370989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.370997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:33600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.371002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.371009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:33608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.371016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.371023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:33616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.371028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.371035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:33624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.371041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.109 [2024-04-23 21:33:37.371050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:33632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.109 [2024-04-23 21:33:37.371056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:33656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:33664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:33672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:33680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:33688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:33696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:33704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:33712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:33720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:33736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:33744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:33752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:33760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:33768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:33776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:33784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:32:43.110 [2024-04-23 21:33:37.371447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:32768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:32784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:32808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:32816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:32832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:32848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:32864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.110 [2024-04-23 21:33:37.371630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:32872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187300 00:32:43.110 [2024-04-23 21:33:37.371636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:32880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:32888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:32904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:32912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:32920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:32928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:32952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:32968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:32976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:32992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:33008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:33032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:33040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:33048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:33056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:33064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.371992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.371998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.372005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.372011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.372018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187300 00:32:43.111 [2024-04-23 21:33:37.372024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.373876] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:32:43.111 [2024-04-23 21:33:37.373889] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:32:43.111 [2024-04-23 21:33:37.373895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:33104 len:8 PRP1 0x0 PRP2 0x0 00:32:43.111 [2024-04-23 21:33:37.373902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:32:43.111 [2024-04-23 21:33:37.373940] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:32:43.111 [2024-04-23 21:33:37.376515] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:32:43.371 [2024-04-23 21:33:37.389994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:32:43.371 [2024-04-23 21:33:37.392973] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:32:43.371 [2024-04-23 21:33:37.392990] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:32:43.371 [2024-04-23 21:33:37.392996] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:32:44.307 [2024-04-23 21:33:38.396937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:32:44.307 [2024-04-23 21:33:38.396961] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:32:44.307 [2024-04-23 21:33:38.397121] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:32:44.307 [2024-04-23 21:33:38.397129] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:32:44.307 [2024-04-23 21:33:38.397137] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:32:44.307 [2024-04-23 21:33:38.398186] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:32:44.307 [2024-04-23 21:33:38.399661] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:32:44.307 [2024-04-23 21:33:38.410932] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:32:44.307 [2024-04-23 21:33:38.413122] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:32:44.307 [2024-04-23 21:33:38.413140] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:32:44.307 [2024-04-23 21:33:38.413146] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:32:45.242 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1572879 Killed "${NVMF_APP[@]}" "$@" 00:32:45.242 21:33:39 -- host/bdevperf.sh@36 -- # tgt_init 00:32:45.242 21:33:39 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:32:45.242 21:33:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:32:45.242 21:33:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:32:45.242 21:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:45.242 21:33:39 -- nvmf/common.sh@470 -- # nvmfpid=1575719 00:32:45.242 21:33:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:32:45.242 21:33:39 -- nvmf/common.sh@471 -- # waitforlisten 1575719 00:32:45.242 21:33:39 -- common/autotest_common.sh@817 -- # '[' -z 1575719 ']' 00:32:45.242 21:33:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:45.242 21:33:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:45.242 21:33:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:45.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:45.242 21:33:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:45.242 21:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:45.242 [2024-04-23 21:33:39.397652] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:32:45.242 [2024-04-23 21:33:39.397692] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:45.242 [2024-04-23 21:33:39.417080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:32:45.242 [2024-04-23 21:33:39.417105] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:32:45.242 [2024-04-23 21:33:39.417266] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:32:45.242 [2024-04-23 21:33:39.417274] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:32:45.242 [2024-04-23 21:33:39.417290] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:32:45.242 [2024-04-23 21:33:39.419793] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:32:45.242 EAL: No free 2048 kB hugepages reported on node 1 00:32:45.242 [2024-04-23 21:33:39.423509] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:32:45.242 [2024-04-23 21:33:39.425752] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:32:45.242 [2024-04-23 21:33:39.425770] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:32:45.242 [2024-04-23 21:33:39.425776] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:32:45.242 [2024-04-23 21:33:39.449779] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:32:45.500 [2024-04-23 21:33:39.522238] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:45.500 [2024-04-23 21:33:39.522269] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:45.500 [2024-04-23 21:33:39.522281] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:32:45.500 [2024-04-23 21:33:39.522287] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:32:45.500 [2024-04-23 21:33:39.522291] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:45.500 [2024-04-23 21:33:39.522331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:45.500 [2024-04-23 21:33:39.522348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:45.501 [2024-04-23 21:33:39.522349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:46.067 21:33:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:46.067 21:33:40 -- common/autotest_common.sh@850 -- # return 0 00:32:46.067 21:33:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:32:46.067 21:33:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:32:46.067 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.067 21:33:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:46.067 21:33:40 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:32:46.067 21:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:46.067 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.067 [2024-04-23 21:33:40.244929] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xcf2ed0/0xcf73c0) succeed. 00:32:46.067 [2024-04-23 21:33:40.253940] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xcf4470/0xd38a50) succeed. 00:32:46.325 21:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:46.325 21:33:40 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:32:46.325 21:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:46.325 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.325 Malloc0 00:32:46.325 21:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:46.325 21:33:40 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:32:46.325 21:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:46.325 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.325 21:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:46.325 21:33:40 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:32:46.325 21:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:46.325 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.325 21:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:46.325 21:33:40 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:32:46.325 21:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:46.325 21:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:46.325 [2024-04-23 21:33:40.394679] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:32:46.325 21:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:46.325 21:33:40 -- host/bdevperf.sh@38 -- # wait 1573697 00:32:46.325 [2024-04-23 21:33:40.429571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:32:46.325 [2024-04-23 21:33:40.429595] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:32:46.325 [2024-04-23 21:33:40.429758] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:32:46.325 [2024-04-23 21:33:40.429765] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:32:46.325 [2024-04-23 21:33:40.429773] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:32:46.325 [2024-04-23 21:33:40.432001] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:32:46.325 [2024-04-23 21:33:40.432299] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:32:46.325 [2024-04-23 21:33:40.444740] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:32:46.325 [2024-04-23 21:33:40.492345] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:32:54.437 00:32:54.437 Latency(us) 00:32:54.437 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:32:54.437 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:32:54.437 Verification LBA range: start 0x0 length 0x4000 00:32:54.437 Nvme1n1 : 15.00 14380.54 56.17 11224.53 0.00 4980.61 329.20 1031488.09 00:32:54.437 =================================================================================================================== 00:32:54.437 Total : 14380.54 56.17 11224.53 0.00 4980.61 329.20 1031488.09 00:32:54.696 21:33:48 -- host/bdevperf.sh@39 -- # sync 00:32:54.696 21:33:48 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:54.696 21:33:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:54.696 21:33:48 -- common/autotest_common.sh@10 -- # set +x 00:32:54.696 21:33:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:54.696 21:33:48 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:32:54.696 21:33:48 -- host/bdevperf.sh@44 -- # nvmftestfini 00:32:54.696 21:33:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:54.696 21:33:48 -- nvmf/common.sh@117 -- # sync 00:32:54.696 21:33:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:32:54.696 21:33:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:32:54.696 21:33:48 -- nvmf/common.sh@120 -- # set +e 00:32:54.696 21:33:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:54.696 21:33:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:32:54.696 rmmod nvme_rdma 00:32:54.696 rmmod nvme_fabrics 00:32:54.955 21:33:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:54.955 21:33:48 -- nvmf/common.sh@124 -- # set -e 00:32:54.955 21:33:48 -- nvmf/common.sh@125 -- # return 0 00:32:54.955 21:33:48 -- nvmf/common.sh@478 -- # '[' -n 1575719 ']' 00:32:54.955 21:33:48 -- nvmf/common.sh@479 -- # killprocess 1575719 00:32:54.955 21:33:48 -- common/autotest_common.sh@936 -- # '[' -z 1575719 ']' 00:32:54.955 21:33:48 -- common/autotest_common.sh@940 -- # kill -0 1575719 00:32:54.955 21:33:48 -- common/autotest_common.sh@941 -- # uname 00:32:54.955 21:33:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:54.955 21:33:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1575719 00:32:54.955 21:33:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:32:54.955 21:33:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:32:54.955 21:33:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1575719' 00:32:54.955 killing process with pid 1575719 00:32:54.955 21:33:49 -- common/autotest_common.sh@955 -- # kill 1575719 00:32:54.955 21:33:49 -- common/autotest_common.sh@960 -- # wait 1575719 00:32:54.955 [2024-04-23 21:33:49.093767] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:32:55.214 21:33:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:32:55.214 21:33:49 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:32:55.214 00:32:55.214 real 0m23.963s 00:32:55.214 user 1m3.865s 00:32:55.214 sys 0m5.047s 00:32:55.214 21:33:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:55.214 21:33:49 -- common/autotest_common.sh@10 -- # set +x 00:32:55.214 ************************************ 00:32:55.214 END TEST nvmf_bdevperf 00:32:55.214 ************************************ 00:32:55.214 21:33:49 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:32:55.214 21:33:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:55.214 21:33:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:55.214 21:33:49 -- common/autotest_common.sh@10 -- # set +x 00:32:55.214 ************************************ 00:32:55.214 START TEST nvmf_target_disconnect 00:32:55.214 ************************************ 00:32:55.214 21:33:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:32:55.473 * Looking for test storage... 00:32:55.473 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:32:55.473 21:33:49 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:32:55.473 21:33:49 -- nvmf/common.sh@7 -- # uname -s 00:32:55.473 21:33:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:55.473 21:33:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:55.473 21:33:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:55.473 21:33:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:55.473 21:33:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:55.473 21:33:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:55.473 21:33:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:55.473 21:33:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:55.473 21:33:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:55.473 21:33:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:55.473 21:33:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:32:55.473 21:33:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:32:55.473 21:33:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:55.473 21:33:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:55.474 21:33:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:55.474 21:33:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:55.474 21:33:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:32:55.474 21:33:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:55.474 21:33:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:55.474 21:33:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:55.474 21:33:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.474 21:33:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.474 21:33:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.474 21:33:49 -- paths/export.sh@5 -- # export PATH 00:32:55.474 21:33:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.474 21:33:49 -- nvmf/common.sh@47 -- # : 0 00:32:55.474 21:33:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:55.474 21:33:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:55.474 21:33:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:55.474 21:33:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:55.474 21:33:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:55.474 21:33:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:55.474 21:33:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:55.474 21:33:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:55.474 21:33:49 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:32:55.474 21:33:49 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:32:55.474 21:33:49 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:32:55.474 21:33:49 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:32:55.474 21:33:49 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:32:55.474 21:33:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:55.474 21:33:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:32:55.474 21:33:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:32:55.474 21:33:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:32:55.474 21:33:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:55.474 21:33:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:55.474 21:33:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:55.474 21:33:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:32:55.474 21:33:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:32:55.474 21:33:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:32:55.474 21:33:49 -- common/autotest_common.sh@10 -- # set +x 00:33:00.744 21:33:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:00.744 21:33:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:00.744 21:33:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:00.744 21:33:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:00.744 21:33:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:00.744 21:33:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:00.744 21:33:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:00.744 21:33:54 -- nvmf/common.sh@295 -- # net_devs=() 00:33:00.744 21:33:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:00.745 21:33:54 -- nvmf/common.sh@296 -- # e810=() 00:33:00.745 21:33:54 -- nvmf/common.sh@296 -- # local -ga e810 00:33:00.745 21:33:54 -- nvmf/common.sh@297 -- # x722=() 00:33:00.745 21:33:54 -- nvmf/common.sh@297 -- # local -ga x722 00:33:00.745 21:33:54 -- nvmf/common.sh@298 -- # mlx=() 00:33:00.745 21:33:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:00.745 21:33:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:00.745 21:33:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:33:00.745 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:33:00.745 21:33:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:00.745 21:33:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:33:00.745 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:33:00.745 21:33:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:00.745 21:33:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:00.745 21:33:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:00.745 21:33:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:33:00.745 Found net devices under 0000:18:00.0: mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:00.745 21:33:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:00.745 21:33:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:33:00.745 Found net devices under 0000:18:00.1: mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:00.745 21:33:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:00.745 21:33:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:00.745 21:33:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:00.745 21:33:54 -- nvmf/common.sh@58 -- # uname 00:33:00.745 21:33:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:00.745 21:33:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:00.745 21:33:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:00.745 21:33:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:00.745 21:33:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:00.745 21:33:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:00.745 21:33:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:00.745 21:33:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:00.745 21:33:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:00.745 21:33:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:00.745 21:33:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:00.745 21:33:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:00.745 21:33:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:00.745 21:33:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:00.745 21:33:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:00.745 21:33:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@105 -- # continue 2 00:33:00.745 21:33:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@105 -- # continue 2 00:33:00.745 21:33:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:00.745 21:33:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.745 21:33:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:00.745 21:33:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:33:00.745 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:00.745 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:33:00.745 altname enp24s0f0np0 00:33:00.745 altname ens785f0np0 00:33:00.745 inet 192.168.100.8/24 scope global mlx_0_0 00:33:00.745 valid_lft forever preferred_lft forever 00:33:00.745 21:33:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:00.745 21:33:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.745 21:33:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:00.745 21:33:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:33:00.745 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:00.745 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:33:00.745 altname enp24s0f1np1 00:33:00.745 altname ens785f1np1 00:33:00.745 inet 192.168.100.9/24 scope global mlx_0_1 00:33:00.745 valid_lft forever preferred_lft forever 00:33:00.745 21:33:54 -- nvmf/common.sh@411 -- # return 0 00:33:00.745 21:33:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:00.745 21:33:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:00.745 21:33:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:00.745 21:33:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:00.745 21:33:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:00.745 21:33:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:00.745 21:33:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:00.745 21:33:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:00.745 21:33:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:00.745 21:33:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@105 -- # continue 2 00:33:00.745 21:33:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.745 21:33:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:00.745 21:33:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@105 -- # continue 2 00:33:00.745 21:33:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:00.745 21:33:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.745 21:33:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:00.745 21:33:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.745 21:33:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.746 21:33:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:00.746 192.168.100.9' 00:33:00.746 21:33:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:00.746 192.168.100.9' 00:33:00.746 21:33:54 -- nvmf/common.sh@446 -- # head -n 1 00:33:00.746 21:33:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:00.746 21:33:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:00.746 192.168.100.9' 00:33:00.746 21:33:54 -- nvmf/common.sh@447 -- # tail -n +2 00:33:00.746 21:33:54 -- nvmf/common.sh@447 -- # head -n 1 00:33:00.746 21:33:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:00.746 21:33:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:00.746 21:33:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:00.746 21:33:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:00.746 21:33:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:00.746 21:33:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:00.746 21:33:54 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:33:00.746 21:33:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:00.746 21:33:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:00.746 21:33:54 -- common/autotest_common.sh@10 -- # set +x 00:33:01.004 ************************************ 00:33:01.004 START TEST nvmf_target_disconnect_tc1 00:33:01.004 ************************************ 00:33:01.004 21:33:55 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:33:01.004 21:33:55 -- host/target_disconnect.sh@32 -- # set +e 00:33:01.004 21:33:55 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:01.004 EAL: No free 2048 kB hugepages reported on node 1 00:33:01.004 [2024-04-23 21:33:55.134541] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:01.004 [2024-04-23 21:33:55.134578] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:01.004 [2024-04-23 21:33:55.134585] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:33:01.939 [2024-04-23 21:33:56.138368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:01.939 [2024-04-23 21:33:56.138392] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:33:01.939 [2024-04-23 21:33:56.138402] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:33:01.939 [2024-04-23 21:33:56.138426] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:33:01.939 [2024-04-23 21:33:56.138444] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:33:01.939 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:33:01.939 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:33:01.939 Initializing NVMe Controllers 00:33:01.939 21:33:56 -- host/target_disconnect.sh@33 -- # trap - ERR 00:33:01.939 21:33:56 -- host/target_disconnect.sh@33 -- # print_backtrace 00:33:01.939 21:33:56 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:33:01.939 21:33:56 -- common/autotest_common.sh@1139 -- # return 0 00:33:01.939 21:33:56 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:33:01.939 21:33:56 -- host/target_disconnect.sh@41 -- # set -e 00:33:01.939 00:33:01.939 real 0m1.101s 00:33:01.939 user 0m0.943s 00:33:01.939 sys 0m0.147s 00:33:01.939 21:33:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:01.939 21:33:56 -- common/autotest_common.sh@10 -- # set +x 00:33:01.939 ************************************ 00:33:01.939 END TEST nvmf_target_disconnect_tc1 00:33:01.939 ************************************ 00:33:01.939 21:33:56 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:33:01.939 21:33:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:01.939 21:33:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:01.939 21:33:56 -- common/autotest_common.sh@10 -- # set +x 00:33:02.198 ************************************ 00:33:02.198 START TEST nvmf_target_disconnect_tc2 00:33:02.198 ************************************ 00:33:02.198 21:33:56 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:33:02.198 21:33:56 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:33:02.198 21:33:56 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:02.198 21:33:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:02.198 21:33:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:02.198 21:33:56 -- common/autotest_common.sh@10 -- # set +x 00:33:02.198 21:33:56 -- nvmf/common.sh@470 -- # nvmfpid=1583491 00:33:02.198 21:33:56 -- nvmf/common.sh@471 -- # waitforlisten 1583491 00:33:02.198 21:33:56 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:02.198 21:33:56 -- common/autotest_common.sh@817 -- # '[' -z 1583491 ']' 00:33:02.198 21:33:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:02.198 21:33:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:02.198 21:33:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:02.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:02.198 21:33:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:02.198 21:33:56 -- common/autotest_common.sh@10 -- # set +x 00:33:02.198 [2024-04-23 21:33:56.362342] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:33:02.198 [2024-04-23 21:33:56.362376] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:02.198 EAL: No free 2048 kB hugepages reported on node 1 00:33:02.198 [2024-04-23 21:33:56.429089] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:02.456 [2024-04-23 21:33:56.497789] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:02.456 [2024-04-23 21:33:56.497823] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:02.456 [2024-04-23 21:33:56.497829] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:02.456 [2024-04-23 21:33:56.497835] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:02.456 [2024-04-23 21:33:56.497840] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:02.456 [2024-04-23 21:33:56.497947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:02.456 [2024-04-23 21:33:56.498054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:02.456 [2024-04-23 21:33:56.498151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:02.456 [2024-04-23 21:33:56.498152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:03.021 21:33:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:03.021 21:33:57 -- common/autotest_common.sh@850 -- # return 0 00:33:03.022 21:33:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:03.022 21:33:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:03.022 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.022 21:33:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:03.022 21:33:57 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:03.022 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.022 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.022 Malloc0 00:33:03.022 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.022 21:33:57 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:03.022 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.022 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.022 [2024-04-23 21:33:57.224486] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x18c17d0/0x18cd340) succeed. 00:33:03.022 [2024-04-23 21:33:57.233987] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x18c2e10/0x196d440) succeed. 00:33:03.315 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.315 21:33:57 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:03.315 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.315 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.315 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.315 21:33:57 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:03.315 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.315 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.315 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.316 21:33:57 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:03.316 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.316 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.316 [2024-04-23 21:33:57.363617] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:03.316 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.316 21:33:57 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:03.316 21:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:03.316 21:33:57 -- common/autotest_common.sh@10 -- # set +x 00:33:03.316 21:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:03.316 21:33:57 -- host/target_disconnect.sh@50 -- # reconnectpid=1583808 00:33:03.316 21:33:57 -- host/target_disconnect.sh@52 -- # sleep 2 00:33:03.316 21:33:57 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:03.316 EAL: No free 2048 kB hugepages reported on node 1 00:33:05.270 21:33:59 -- host/target_disconnect.sh@53 -- # kill -9 1583491 00:33:05.270 21:33:59 -- host/target_disconnect.sh@55 -- # sleep 2 00:33:06.644 Write completed with error (sct=0, sc=8) 00:33:06.644 starting I/O failed 00:33:06.644 Write completed with error (sct=0, sc=8) 00:33:06.644 starting I/O failed 00:33:06.644 Write completed with error (sct=0, sc=8) 00:33:06.644 starting I/O failed 00:33:06.644 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Write completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 Read completed with error (sct=0, sc=8) 00:33:06.645 starting I/O failed 00:33:06.645 [2024-04-23 21:34:00.540139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:07.210 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1583491 Killed "${NVMF_APP[@]}" "$@" 00:33:07.210 21:34:01 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:33:07.210 21:34:01 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:07.210 21:34:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:07.210 21:34:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:07.210 21:34:01 -- common/autotest_common.sh@10 -- # set +x 00:33:07.210 21:34:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:07.210 21:34:01 -- nvmf/common.sh@470 -- # nvmfpid=1585143 00:33:07.210 21:34:01 -- nvmf/common.sh@471 -- # waitforlisten 1585143 00:33:07.210 21:34:01 -- common/autotest_common.sh@817 -- # '[' -z 1585143 ']' 00:33:07.210 21:34:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:07.210 21:34:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:07.210 21:34:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:07.210 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:07.210 21:34:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:07.210 21:34:01 -- common/autotest_common.sh@10 -- # set +x 00:33:07.210 [2024-04-23 21:34:01.417488] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:33:07.210 [2024-04-23 21:34:01.417529] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:07.210 EAL: No free 2048 kB hugepages reported on node 1 00:33:07.468 [2024-04-23 21:34:01.485032] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Read completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 Write completed with error (sct=0, sc=8) 00:33:07.468 starting I/O failed 00:33:07.468 [2024-04-23 21:34:01.545181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:07.468 [2024-04-23 21:34:01.554248] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:07.468 [2024-04-23 21:34:01.554273] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:07.468 [2024-04-23 21:34:01.554286] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:07.468 [2024-04-23 21:34:01.554291] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:07.468 [2024-04-23 21:34:01.554296] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:07.468 [2024-04-23 21:34:01.554424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:07.468 [2024-04-23 21:34:01.554528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:07.468 [2024-04-23 21:34:01.554632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:07.468 [2024-04-23 21:34:01.554633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:08.033 21:34:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:08.033 21:34:02 -- common/autotest_common.sh@850 -- # return 0 00:33:08.034 21:34:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:08.034 21:34:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:08.034 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.034 21:34:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:08.034 21:34:02 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:08.034 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.034 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.034 Malloc0 00:33:08.034 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.034 21:34:02 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:08.034 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.034 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.034 [2024-04-23 21:34:02.282836] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x24a57d0/0x24b1340) succeed. 00:33:08.034 [2024-04-23 21:34:02.292497] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x24a6e10/0x2551440) succeed. 00:33:08.292 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.292 21:34:02 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:08.292 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.292 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.292 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.292 21:34:02 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:08.292 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.292 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.292 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.292 21:34:02 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:08.292 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.292 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.292 [2024-04-23 21:34:02.421611] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:08.292 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.292 21:34:02 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:08.292 21:34:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:08.292 21:34:02 -- common/autotest_common.sh@10 -- # set +x 00:33:08.292 21:34:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:08.292 21:34:02 -- host/target_disconnect.sh@58 -- # wait 1583808 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Write completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 Read completed with error (sct=0, sc=8) 00:33:08.292 starting I/O failed 00:33:08.292 [2024-04-23 21:34:02.550113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.292 [2024-04-23 21:34:02.562483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.292 [2024-04-23 21:34:02.562531] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.293 [2024-04-23 21:34:02.562550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.293 [2024-04-23 21:34:02.562558] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.293 [2024-04-23 21:34:02.562564] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.551 [2024-04-23 21:34:02.572777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.551 qpair failed and we were unable to recover it. 00:33:08.551 [2024-04-23 21:34:02.582595] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.551 [2024-04-23 21:34:02.582636] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.551 [2024-04-23 21:34:02.582651] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.551 [2024-04-23 21:34:02.582657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.551 [2024-04-23 21:34:02.582663] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.551 [2024-04-23 21:34:02.592839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.551 qpair failed and we were unable to recover it. 00:33:08.551 [2024-04-23 21:34:02.602511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.551 [2024-04-23 21:34:02.602548] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.551 [2024-04-23 21:34:02.602562] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.551 [2024-04-23 21:34:02.602569] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.551 [2024-04-23 21:34:02.602574] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.551 [2024-04-23 21:34:02.612987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.551 qpair failed and we were unable to recover it. 00:33:08.551 [2024-04-23 21:34:02.622601] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.551 [2024-04-23 21:34:02.622641] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.551 [2024-04-23 21:34:02.622655] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.551 [2024-04-23 21:34:02.622661] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.551 [2024-04-23 21:34:02.622667] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.551 [2024-04-23 21:34:02.633057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.551 qpair failed and we were unable to recover it. 00:33:08.551 [2024-04-23 21:34:02.642707] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.551 [2024-04-23 21:34:02.642744] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.551 [2024-04-23 21:34:02.642758] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.551 [2024-04-23 21:34:02.642764] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.642770] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.653110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.662759] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.662797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.662814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.662820] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.662825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.673085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.682801] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.682840] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.682853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.682860] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.682865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.693290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.702913] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.702952] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.702966] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.702972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.702978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.713135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.722859] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.722896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.722911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.722917] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.722923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.733294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.742985] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.743015] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.743029] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.743036] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.743044] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.753158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.762999] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.763029] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.763043] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.763049] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.763055] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.773463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.783169] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.783205] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.783218] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.783224] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.783229] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.793511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.552 [2024-04-23 21:34:02.803155] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.552 [2024-04-23 21:34:02.803197] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.552 [2024-04-23 21:34:02.803211] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.552 [2024-04-23 21:34:02.803217] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.552 [2024-04-23 21:34:02.803222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.552 [2024-04-23 21:34:02.813569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.552 qpair failed and we were unable to recover it. 00:33:08.810 [2024-04-23 21:34:02.823197] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.810 [2024-04-23 21:34:02.823236] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.810 [2024-04-23 21:34:02.823249] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.810 [2024-04-23 21:34:02.823255] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.810 [2024-04-23 21:34:02.823261] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.810 [2024-04-23 21:34:02.833656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.810 qpair failed and we were unable to recover it. 00:33:08.810 [2024-04-23 21:34:02.843195] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.810 [2024-04-23 21:34:02.843232] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.810 [2024-04-23 21:34:02.843245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.810 [2024-04-23 21:34:02.843251] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.810 [2024-04-23 21:34:02.843256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.810 [2024-04-23 21:34:02.853711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.810 qpair failed and we were unable to recover it. 00:33:08.810 [2024-04-23 21:34:02.863360] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.810 [2024-04-23 21:34:02.863395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.810 [2024-04-23 21:34:02.863408] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.810 [2024-04-23 21:34:02.863414] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.810 [2024-04-23 21:34:02.863420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.810 [2024-04-23 21:34:02.873860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.810 qpair failed and we were unable to recover it. 00:33:08.810 [2024-04-23 21:34:02.883338] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.810 [2024-04-23 21:34:02.883378] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.810 [2024-04-23 21:34:02.883391] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.810 [2024-04-23 21:34:02.883397] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.810 [2024-04-23 21:34:02.883402] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.810 [2024-04-23 21:34:02.893857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.810 qpair failed and we were unable to recover it. 00:33:08.810 [2024-04-23 21:34:02.903311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.810 [2024-04-23 21:34:02.903345] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.810 [2024-04-23 21:34:02.903359] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.810 [2024-04-23 21:34:02.903365] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:02.903370] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:02.913804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:02.923501] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:02.923540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:02.923555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:02.923563] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:02.923569] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:02.933937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:02.943551] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:02.943586] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:02.943600] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:02.943606] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:02.943611] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:02.953935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:02.963638] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:02.963672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:02.963686] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:02.963692] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:02.963697] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:02.973873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:02.983664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:02.983701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:02.983714] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:02.983720] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:02.983725] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:02.993888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:03.003700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:03.003736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:03.003750] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:03.003756] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:03.003761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:03.014116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:03.023795] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:03.023829] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:03.023843] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:03.023850] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:03.023855] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:03.034137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:03.043849] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:03.043886] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:03.043899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:03.043905] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:03.043910] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:03.054287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:08.811 [2024-04-23 21:34:03.063869] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:08.811 [2024-04-23 21:34:03.063905] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:08.811 [2024-04-23 21:34:03.063918] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:08.811 [2024-04-23 21:34:03.063924] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:08.811 [2024-04-23 21:34:03.063929] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:08.811 [2024-04-23 21:34:03.074284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:08.811 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.083884] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.083917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.083930] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.083936] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.083942] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.094319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.103963] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.104000] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.104016] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.104022] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.104028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.114221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.124057] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.124095] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.124108] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.124114] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.124119] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.134483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.144180] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.144218] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.144231] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.144237] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.144242] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.154466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.164151] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.164187] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.164201] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.164207] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.164213] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.174615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.184311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.184348] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.184361] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.184367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.184375] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.194636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.204354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.204395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.204409] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.204415] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.204420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.214639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.224399] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.224436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.224449] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.070 [2024-04-23 21:34:03.224456] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.070 [2024-04-23 21:34:03.224461] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.070 [2024-04-23 21:34:03.234662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.070 qpair failed and we were unable to recover it. 00:33:09.070 [2024-04-23 21:34:03.244465] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.070 [2024-04-23 21:34:03.244502] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.070 [2024-04-23 21:34:03.244515] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.071 [2024-04-23 21:34:03.244521] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.071 [2024-04-23 21:34:03.244526] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.071 [2024-04-23 21:34:03.254759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.071 qpair failed and we were unable to recover it. 00:33:09.071 [2024-04-23 21:34:03.264509] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.071 [2024-04-23 21:34:03.264542] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.071 [2024-04-23 21:34:03.264555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.071 [2024-04-23 21:34:03.264561] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.071 [2024-04-23 21:34:03.264566] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.071 [2024-04-23 21:34:03.274846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.071 qpair failed and we were unable to recover it. 00:33:09.071 [2024-04-23 21:34:03.284564] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.071 [2024-04-23 21:34:03.284599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.071 [2024-04-23 21:34:03.284613] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.071 [2024-04-23 21:34:03.284619] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.071 [2024-04-23 21:34:03.284624] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.071 [2024-04-23 21:34:03.294907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.071 qpair failed and we were unable to recover it. 00:33:09.071 [2024-04-23 21:34:03.304727] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.071 [2024-04-23 21:34:03.304759] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.071 [2024-04-23 21:34:03.304773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.071 [2024-04-23 21:34:03.304780] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.071 [2024-04-23 21:34:03.304786] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.071 [2024-04-23 21:34:03.314827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.071 qpair failed and we were unable to recover it. 00:33:09.071 [2024-04-23 21:34:03.324688] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.071 [2024-04-23 21:34:03.324717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.071 [2024-04-23 21:34:03.324731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.071 [2024-04-23 21:34:03.324737] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.071 [2024-04-23 21:34:03.324743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.071 [2024-04-23 21:34:03.334985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.071 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.344740] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.344776] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.344790] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.344796] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.344801] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.354925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.364827] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.364867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.364880] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.364889] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.364895] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.375103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.384805] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.384840] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.384853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.384859] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.384865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.395239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.404938] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.404970] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.404984] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.404990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.404995] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.415177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.424843] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.424880] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.424893] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.424899] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.424905] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.435191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.445076] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.445117] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.445131] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.445138] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.445143] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.455217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.465083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.465121] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.465135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.465141] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.465146] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.475360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.485112] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.485151] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.485164] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.485170] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.485175] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.495175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.505198] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.505233] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.505246] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.505252] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.505257] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.515720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.525209] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.525251] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.525264] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.525270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.330 [2024-04-23 21:34:03.525279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.330 [2024-04-23 21:34:03.535566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.330 qpair failed and we were unable to recover it. 00:33:09.330 [2024-04-23 21:34:03.545356] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.330 [2024-04-23 21:34:03.545387] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.330 [2024-04-23 21:34:03.545403] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.330 [2024-04-23 21:34:03.545410] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.331 [2024-04-23 21:34:03.545415] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.331 [2024-04-23 21:34:03.555642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.331 qpair failed and we were unable to recover it. 00:33:09.331 [2024-04-23 21:34:03.565252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.331 [2024-04-23 21:34:03.565296] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.331 [2024-04-23 21:34:03.565309] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.331 [2024-04-23 21:34:03.565315] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.331 [2024-04-23 21:34:03.565321] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.331 [2024-04-23 21:34:03.575674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.331 qpair failed and we were unable to recover it. 00:33:09.331 [2024-04-23 21:34:03.585318] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.331 [2024-04-23 21:34:03.585354] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.331 [2024-04-23 21:34:03.585367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.331 [2024-04-23 21:34:03.585374] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.331 [2024-04-23 21:34:03.585379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.331 [2024-04-23 21:34:03.595760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.331 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.605424] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.605458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.605471] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.605477] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.605482] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.615869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.625490] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.625525] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.625540] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.625546] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.625554] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.635708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.645467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.645499] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.645513] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.645519] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.645524] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.656028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.665659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.665694] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.665707] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.665713] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.665718] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.676048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.685720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.685753] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.685767] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.685773] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.685778] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.696115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.705738] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.705781] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.705795] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.705801] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.705806] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.716228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.725776] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.725808] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.725821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.725827] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.725833] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.736178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.745762] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.745801] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.745814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.745820] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.745825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.756209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.765900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.765940] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.765954] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.765959] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.765965] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.776170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.590 [2024-04-23 21:34:03.786000] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.590 [2024-04-23 21:34:03.786036] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.590 [2024-04-23 21:34:03.786049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.590 [2024-04-23 21:34:03.786055] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.590 [2024-04-23 21:34:03.786061] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.590 [2024-04-23 21:34:03.796429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.590 qpair failed and we were unable to recover it. 00:33:09.591 [2024-04-23 21:34:03.805958] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.591 [2024-04-23 21:34:03.805993] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.591 [2024-04-23 21:34:03.806006] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.591 [2024-04-23 21:34:03.806017] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.591 [2024-04-23 21:34:03.806022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.591 [2024-04-23 21:34:03.816319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.591 qpair failed and we were unable to recover it. 00:33:09.591 [2024-04-23 21:34:03.826051] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.591 [2024-04-23 21:34:03.826088] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.591 [2024-04-23 21:34:03.826101] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.591 [2024-04-23 21:34:03.826107] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.591 [2024-04-23 21:34:03.826113] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.591 [2024-04-23 21:34:03.836453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.591 qpair failed and we were unable to recover it. 00:33:09.591 [2024-04-23 21:34:03.846112] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.591 [2024-04-23 21:34:03.846144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.591 [2024-04-23 21:34:03.846157] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.591 [2024-04-23 21:34:03.846163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.591 [2024-04-23 21:34:03.846168] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.591 [2024-04-23 21:34:03.856357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.591 qpair failed and we were unable to recover it. 00:33:09.849 [2024-04-23 21:34:03.866218] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.849 [2024-04-23 21:34:03.866254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.849 [2024-04-23 21:34:03.866268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.849 [2024-04-23 21:34:03.866274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.849 [2024-04-23 21:34:03.866284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.849 [2024-04-23 21:34:03.876667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.849 qpair failed and we were unable to recover it. 00:33:09.849 [2024-04-23 21:34:03.886187] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.886224] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.886238] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.886244] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.886249] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.896640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:03.906249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.906288] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.906302] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.906307] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.906313] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.916708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:03.926371] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.926406] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.926419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.926425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.926430] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.936930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:03.946404] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.946443] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.946457] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.946463] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.946469] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.956824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:03.966471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.966506] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.966519] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.966526] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.966531] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.976758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:03.986504] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:03.986538] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:03.986554] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:03.986560] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:03.986565] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:03.996910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.006595] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.006632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.006645] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.006651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.006656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.016831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.026578] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.026619] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.026632] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.026638] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.026644] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.037119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.046700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.046738] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.046752] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.046757] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.046763] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.057225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.066576] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.066612] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.066625] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.066631] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.066640] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.077324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.086799] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.086838] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.086852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.086858] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.086863] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.097049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:09.850 [2024-04-23 21:34:04.106861] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:09.850 [2024-04-23 21:34:04.106898] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:09.850 [2024-04-23 21:34:04.106911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:09.850 [2024-04-23 21:34:04.106917] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:09.850 [2024-04-23 21:34:04.106923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:09.850 [2024-04-23 21:34:04.117349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:09.850 qpair failed and we were unable to recover it. 00:33:10.109 [2024-04-23 21:34:04.126792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.126828] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.126841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.126847] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.126853] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.137312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.146989] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.147025] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.147038] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.147044] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.147050] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.157499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.167018] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.167056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.167070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.167076] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.167081] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.177486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.187086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.187127] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.187140] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.187146] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.187152] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.197575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.207102] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.207139] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.207152] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.207158] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.207163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.217556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.227172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.227210] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.227223] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.227229] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.227234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.237672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.247235] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.247274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.247291] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.247299] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.247305] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.257677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.267218] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.267258] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.267271] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.267282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.267288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.277743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.287422] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.287459] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.287472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.287478] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.287484] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.297802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.307528] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.307562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.307577] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.307582] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.307588] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.317955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.327457] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.327498] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.327512] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.327518] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.327524] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.337705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.347554] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.347592] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.347605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.347611] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.347617] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.358077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.110 [2024-04-23 21:34:04.367552] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.110 [2024-04-23 21:34:04.367581] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.110 [2024-04-23 21:34:04.367595] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.110 [2024-04-23 21:34:04.367601] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.110 [2024-04-23 21:34:04.367606] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.110 [2024-04-23 21:34:04.377899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.110 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.387668] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.387705] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.387718] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.387724] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.387729] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.398036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.407803] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.407840] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.407854] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.407860] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.407865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.418229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.427746] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.427785] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.427801] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.427807] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.427813] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.438230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.447781] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.447815] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.447829] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.447835] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.447840] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.458161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.467868] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.467905] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.467919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.467925] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.467930] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.478340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.487925] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.487966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.487979] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.487986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.487991] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.498232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.507979] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.508012] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.508025] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.508031] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.369 [2024-04-23 21:34:04.508039] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.369 [2024-04-23 21:34:04.518456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.369 qpair failed and we were unable to recover it. 00:33:10.369 [2024-04-23 21:34:04.528116] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.369 [2024-04-23 21:34:04.528151] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.369 [2024-04-23 21:34:04.528166] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.369 [2024-04-23 21:34:04.528173] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.528178] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.538461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.370 [2024-04-23 21:34:04.548095] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.370 [2024-04-23 21:34:04.548131] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.370 [2024-04-23 21:34:04.548146] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.370 [2024-04-23 21:34:04.548152] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.548157] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.558397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.370 [2024-04-23 21:34:04.568035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.370 [2024-04-23 21:34:04.568070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.370 [2024-04-23 21:34:04.568084] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.370 [2024-04-23 21:34:04.568090] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.568096] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.578527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.370 [2024-04-23 21:34:04.588119] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.370 [2024-04-23 21:34:04.588155] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.370 [2024-04-23 21:34:04.588169] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.370 [2024-04-23 21:34:04.588175] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.588181] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.598593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.370 [2024-04-23 21:34:04.608264] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.370 [2024-04-23 21:34:04.608304] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.370 [2024-04-23 21:34:04.608318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.370 [2024-04-23 21:34:04.608324] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.608330] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.618527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.370 [2024-04-23 21:34:04.628299] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.370 [2024-04-23 21:34:04.628334] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.370 [2024-04-23 21:34:04.628347] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.370 [2024-04-23 21:34:04.628353] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.370 [2024-04-23 21:34:04.628359] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.370 [2024-04-23 21:34:04.638725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.370 qpair failed and we were unable to recover it. 00:33:10.629 [2024-04-23 21:34:04.648356] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.629 [2024-04-23 21:34:04.648391] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.629 [2024-04-23 21:34:04.648403] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.648409] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.648415] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.658935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.668543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.668577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.668590] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.668596] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.668601] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.678966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.688479] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.688510] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.688523] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.688532] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.688537] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.698820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.708567] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.708604] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.708617] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.708624] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.708629] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.719039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.728583] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.728618] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.728631] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.728637] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.728642] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.739047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.748753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.748791] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.748805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.748810] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.748816] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.758902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.768678] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.768715] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.768729] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.768735] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.768740] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.779072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.788834] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.788868] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.788883] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.788889] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.788895] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.799162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.808730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.808770] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.808784] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.808790] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.808795] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.819218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.829028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.829067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.829081] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.829088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.829093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.839310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.849019] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.849052] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.849065] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.849071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.849076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.859342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.868920] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.868957] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.868973] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.868979] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.868984] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.879424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.630 [2024-04-23 21:34:04.889127] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.630 [2024-04-23 21:34:04.889162] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.630 [2024-04-23 21:34:04.889176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.630 [2024-04-23 21:34:04.889182] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.630 [2024-04-23 21:34:04.889187] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.630 [2024-04-23 21:34:04.899445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.630 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:04.909045] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:04.909080] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:04.909094] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:04.909101] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:04.909106] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:04.919632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:04.929245] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:04.929280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:04.929295] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:04.929301] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:04.929306] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:04.939666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:04.949293] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:04.949328] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:04.949342] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:04.949348] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:04.949356] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:04.959643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:04.969396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:04.969432] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:04.969445] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:04.969451] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:04.969457] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:04.979626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:04.989409] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:04.989447] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:04.989460] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:04.989466] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:04.989471] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:04.999788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.009537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.009574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.009587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.009593] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.009599] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.019888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.029549] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.029582] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.029596] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.029602] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.029608] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.039692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.049619] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.049656] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.049670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.049676] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.049681] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.059859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.069698] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.069730] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.069743] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.069749] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.069754] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.080051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.089765] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.089802] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.089815] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.089822] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.089827] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.100068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.109798] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.109830] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.109843] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.109850] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.109855] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.120153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.129901] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.129938] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.129951] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.890 [2024-04-23 21:34:05.129962] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.890 [2024-04-23 21:34:05.129967] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.890 [2024-04-23 21:34:05.140085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.890 qpair failed and we were unable to recover it. 00:33:10.890 [2024-04-23 21:34:05.149961] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:10.890 [2024-04-23 21:34:05.149994] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:10.890 [2024-04-23 21:34:05.150007] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:10.891 [2024-04-23 21:34:05.150013] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:10.891 [2024-04-23 21:34:05.150019] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:10.891 [2024-04-23 21:34:05.160050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:10.891 qpair failed and we were unable to recover it. 00:33:11.149 [2024-04-23 21:34:05.170020] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.149 [2024-04-23 21:34:05.170056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.149 [2024-04-23 21:34:05.170069] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.149 [2024-04-23 21:34:05.170075] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.149 [2024-04-23 21:34:05.170081] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.149 [2024-04-23 21:34:05.180371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.149 qpair failed and we were unable to recover it. 00:33:11.149 [2024-04-23 21:34:05.190023] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.149 [2024-04-23 21:34:05.190057] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.149 [2024-04-23 21:34:05.190070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.190076] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.190082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.200524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.210070] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.210109] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.210123] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.210129] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.210134] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.220427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.230066] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.230102] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.230116] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.230121] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.230127] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.240525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.250105] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.250136] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.250150] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.250157] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.250163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.260503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.270158] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.270193] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.270207] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.270213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.270218] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.280584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.290324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.290364] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.290378] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.290385] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.290390] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.300716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.310451] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.310482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.310498] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.310504] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.310509] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.320701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.330372] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.330405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.330419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.330425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.330430] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.340663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.350393] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.350430] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.350443] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.350449] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.350454] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.360609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.370405] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.370446] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.370460] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.370466] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.370471] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.380818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.390505] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.390541] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.390554] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.390560] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.390568] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.150 [2024-04-23 21:34:05.400916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.150 qpair failed and we were unable to recover it. 00:33:11.150 [2024-04-23 21:34:05.410455] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.150 [2024-04-23 21:34:05.410489] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.150 [2024-04-23 21:34:05.410503] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.150 [2024-04-23 21:34:05.410508] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.150 [2024-04-23 21:34:05.410514] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.409 [2024-04-23 21:34:05.420955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.409 qpair failed and we were unable to recover it. 00:33:11.409 [2024-04-23 21:34:05.430605] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.409 [2024-04-23 21:34:05.430638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.409 [2024-04-23 21:34:05.430651] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.409 [2024-04-23 21:34:05.430657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.409 [2024-04-23 21:34:05.430662] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.409 [2024-04-23 21:34:05.441034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.409 qpair failed and we were unable to recover it. 00:33:11.409 [2024-04-23 21:34:05.450650] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.409 [2024-04-23 21:34:05.450684] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.409 [2024-04-23 21:34:05.450698] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.450704] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.450709] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.461060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.470720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.470753] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.470769] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.470775] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.470781] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.481006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.490753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.490795] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.490808] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.490814] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.490819] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.501067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.510798] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.510833] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.510846] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.510853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.510858] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.521274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.530769] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.530806] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.530821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.530828] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.530833] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.541468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.550932] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.550964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.550978] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.550984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.550989] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.561301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.570872] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.570907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.570924] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.570930] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.570935] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.581495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.591085] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.591122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.591135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.591142] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.591147] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.601294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.611032] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.611073] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.611088] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.611094] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.611099] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.621536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.631133] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.631172] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.631185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.631191] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.631197] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.641645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.651213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.651252] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.651265] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.651270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.651280] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.410 [2024-04-23 21:34:05.661704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.410 qpair failed and we were unable to recover it. 00:33:11.410 [2024-04-23 21:34:05.671272] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.410 [2024-04-23 21:34:05.671312] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.410 [2024-04-23 21:34:05.671325] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.410 [2024-04-23 21:34:05.671331] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.410 [2024-04-23 21:34:05.671336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.681677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.691322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.691361] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.691374] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.691380] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.691385] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.701912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.711420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.711454] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.711467] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.711473] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.711478] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.721933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.731492] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.731527] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.731540] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.731546] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.731552] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.741936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.751618] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.751652] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.751668] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.751674] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.751679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.761916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.771617] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.771651] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.771665] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.771671] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.771676] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.782050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.791628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.791664] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.791677] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.791683] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.791689] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.802011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.811696] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.811734] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.811747] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.811753] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.811759] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.822015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.831753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.831789] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.831803] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.831808] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.831816] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.842336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.851788] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.851825] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.670 [2024-04-23 21:34:05.851838] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.670 [2024-04-23 21:34:05.851844] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.670 [2024-04-23 21:34:05.851849] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.670 [2024-04-23 21:34:05.862294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.670 qpair failed and we were unable to recover it. 00:33:11.670 [2024-04-23 21:34:05.871769] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.670 [2024-04-23 21:34:05.871801] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.671 [2024-04-23 21:34:05.871815] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.671 [2024-04-23 21:34:05.871821] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.671 [2024-04-23 21:34:05.871826] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.671 [2024-04-23 21:34:05.882491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.671 qpair failed and we were unable to recover it. 00:33:11.671 [2024-04-23 21:34:05.891928] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.671 [2024-04-23 21:34:05.891967] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.671 [2024-04-23 21:34:05.891980] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.671 [2024-04-23 21:34:05.891986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.671 [2024-04-23 21:34:05.891991] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.671 [2024-04-23 21:34:05.902223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.671 qpair failed and we were unable to recover it. 00:33:11.671 [2024-04-23 21:34:05.912000] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.671 [2024-04-23 21:34:05.912036] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.671 [2024-04-23 21:34:05.912049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.671 [2024-04-23 21:34:05.912055] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.671 [2024-04-23 21:34:05.912060] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.671 [2024-04-23 21:34:05.922345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.671 qpair failed and we were unable to recover it. 00:33:11.671 [2024-04-23 21:34:05.931922] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.671 [2024-04-23 21:34:05.931962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.671 [2024-04-23 21:34:05.931976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.671 [2024-04-23 21:34:05.931982] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.671 [2024-04-23 21:34:05.931988] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:05.942426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:05.951991] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:05.952028] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:05.952041] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:05.952047] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:05.952052] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:05.962508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:05.972249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:05.972287] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:05.972300] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:05.972306] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:05.972311] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:05.982518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:05.992159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:05.992195] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:05.992209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:05.992214] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:05.992220] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.002546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:06.012192] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:06.012227] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:06.012245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:06.012251] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:06.012256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.022665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:06.032370] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:06.032402] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:06.032416] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:06.032423] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:06.032428] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.042578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:06.052340] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:06.052376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:06.052389] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:06.052395] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:06.052401] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.062680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:06.072423] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:06.072460] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:06.072473] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:06.072479] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:06.072485] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.082780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.931 [2024-04-23 21:34:06.092569] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.931 [2024-04-23 21:34:06.092606] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.931 [2024-04-23 21:34:06.092620] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.931 [2024-04-23 21:34:06.092626] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.931 [2024-04-23 21:34:06.092631] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.931 [2024-04-23 21:34:06.102774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.931 qpair failed and we were unable to recover it. 00:33:11.932 [2024-04-23 21:34:06.112442] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.932 [2024-04-23 21:34:06.112478] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.932 [2024-04-23 21:34:06.112491] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.932 [2024-04-23 21:34:06.112497] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.932 [2024-04-23 21:34:06.112502] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.932 [2024-04-23 21:34:06.122849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.932 qpair failed and we were unable to recover it. 00:33:11.932 [2024-04-23 21:34:06.132632] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.932 [2024-04-23 21:34:06.132662] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.932 [2024-04-23 21:34:06.132675] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.932 [2024-04-23 21:34:06.132681] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.932 [2024-04-23 21:34:06.132686] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.932 [2024-04-23 21:34:06.142964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.932 qpair failed and we were unable to recover it. 00:33:11.932 [2024-04-23 21:34:06.152779] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.932 [2024-04-23 21:34:06.152814] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.932 [2024-04-23 21:34:06.152827] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.932 [2024-04-23 21:34:06.152832] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.932 [2024-04-23 21:34:06.152837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.932 [2024-04-23 21:34:06.163094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.932 qpair failed and we were unable to recover it. 00:33:11.932 [2024-04-23 21:34:06.172727] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.932 [2024-04-23 21:34:06.172767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.932 [2024-04-23 21:34:06.172780] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.932 [2024-04-23 21:34:06.172786] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.932 [2024-04-23 21:34:06.172791] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:11.932 [2024-04-23 21:34:06.182947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:11.932 qpair failed and we were unable to recover it. 00:33:11.932 [2024-04-23 21:34:06.192757] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:11.932 [2024-04-23 21:34:06.192791] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:11.932 [2024-04-23 21:34:06.192807] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:11.932 [2024-04-23 21:34:06.192813] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:11.932 [2024-04-23 21:34:06.192818] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.203200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.212795] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.212834] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.212847] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.212853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.212858] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.223111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.232905] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.232941] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.232955] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.232960] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.232966] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.243257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.252926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.252963] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.252977] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.252984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.252989] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.263130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.273059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.273092] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.273105] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.273111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.273120] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.283396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.293040] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.293074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.293089] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.293096] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.293102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.303488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.313110] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.313145] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.313160] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.313166] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.313171] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.323480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.333248] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.333292] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.333306] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.333313] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.333319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.343608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.353254] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.353290] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.353303] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.353309] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.353314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.363478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.373376] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.373412] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.373425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.373431] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.373436] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.383748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.393322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.393357] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.393370] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.393376] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.393381] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.403670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.413366] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.413405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.413418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.413423] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.192 [2024-04-23 21:34:06.413429] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.192 [2024-04-23 21:34:06.423712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.192 qpair failed and we were unable to recover it. 00:33:12.192 [2024-04-23 21:34:06.433498] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.192 [2024-04-23 21:34:06.433530] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.192 [2024-04-23 21:34:06.433543] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.192 [2024-04-23 21:34:06.433549] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.193 [2024-04-23 21:34:06.433554] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.193 [2024-04-23 21:34:06.443885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.193 qpair failed and we were unable to recover it. 00:33:12.193 [2024-04-23 21:34:06.453594] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.193 [2024-04-23 21:34:06.453628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.193 [2024-04-23 21:34:06.453646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.193 [2024-04-23 21:34:06.453652] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.193 [2024-04-23 21:34:06.453657] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.452 [2024-04-23 21:34:06.463954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.452 qpair failed and we were unable to recover it. 00:33:12.452 [2024-04-23 21:34:06.473660] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.452 [2024-04-23 21:34:06.473696] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.452 [2024-04-23 21:34:06.473709] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.452 [2024-04-23 21:34:06.473716] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.452 [2024-04-23 21:34:06.473721] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.452 [2024-04-23 21:34:06.483909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.452 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.493624] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.493666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.493679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.493685] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.493690] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.504030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.513770] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.513803] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.513817] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.513822] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.513828] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.524006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.533855] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.533889] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.533905] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.533911] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.533916] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.544214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.553878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.553912] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.553926] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.553932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.553938] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.564219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.573818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.573856] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.573870] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.573876] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.573881] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.584178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.594001] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.594038] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.594052] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.594058] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.594063] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.604473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.614020] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.614058] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.614071] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.614077] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.614082] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.624335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.634045] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.634081] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.634097] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.634103] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.634108] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.644499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.654153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.654191] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.654205] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.654211] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.654216] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.664455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.674212] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.674245] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.674258] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.674263] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.674269] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.684511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.694367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.694405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.694418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.694424] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.694430] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.453 [2024-04-23 21:34:06.704550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.453 qpair failed and we were unable to recover it. 00:33:12.453 [2024-04-23 21:34:06.714436] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.453 [2024-04-23 21:34:06.714470] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.453 [2024-04-23 21:34:06.714483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.453 [2024-04-23 21:34:06.714489] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.453 [2024-04-23 21:34:06.714497] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.724584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.734429] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.734461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.734474] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.734480] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.734485] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.744752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.754483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.754521] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.754534] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.754540] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.754546] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.764855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.774579] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.774616] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.774630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.774636] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.774641] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.784870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.794642] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.794681] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.794694] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.794700] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.794706] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.804948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.814743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.814777] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.814791] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.814797] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.814802] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.825047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.834813] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.834851] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.834864] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.834870] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.834876] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.845003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.854905] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.854945] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.854958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.854964] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.713 [2024-04-23 21:34:06.854969] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.713 [2024-04-23 21:34:06.865135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.713 qpair failed and we were unable to recover it. 00:33:12.713 [2024-04-23 21:34:06.874830] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.713 [2024-04-23 21:34:06.874862] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.713 [2024-04-23 21:34:06.874876] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.713 [2024-04-23 21:34:06.874882] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.874887] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.714 [2024-04-23 21:34:06.885201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.714 qpair failed and we were unable to recover it. 00:33:12.714 [2024-04-23 21:34:06.894842] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.714 [2024-04-23 21:34:06.894881] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.714 [2024-04-23 21:34:06.894899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.714 [2024-04-23 21:34:06.894905] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.894910] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.714 [2024-04-23 21:34:06.905200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.714 qpair failed and we were unable to recover it. 00:33:12.714 [2024-04-23 21:34:06.914822] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.714 [2024-04-23 21:34:06.914855] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.714 [2024-04-23 21:34:06.914869] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.714 [2024-04-23 21:34:06.914875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.914880] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.714 [2024-04-23 21:34:06.925246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.714 qpair failed and we were unable to recover it. 00:33:12.714 [2024-04-23 21:34:06.934916] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.714 [2024-04-23 21:34:06.934948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.714 [2024-04-23 21:34:06.934961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.714 [2024-04-23 21:34:06.934967] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.934972] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.714 [2024-04-23 21:34:06.945455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.714 qpair failed and we were unable to recover it. 00:33:12.714 [2024-04-23 21:34:06.955089] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.714 [2024-04-23 21:34:06.955126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.714 [2024-04-23 21:34:06.955139] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.714 [2024-04-23 21:34:06.955145] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.955151] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.714 [2024-04-23 21:34:06.965453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.714 qpair failed and we were unable to recover it. 00:33:12.714 [2024-04-23 21:34:06.975086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.714 [2024-04-23 21:34:06.975125] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.714 [2024-04-23 21:34:06.975138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.714 [2024-04-23 21:34:06.975145] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.714 [2024-04-23 21:34:06.975150] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.973 [2024-04-23 21:34:06.985504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:06.995161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:06.995194] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:06.995207] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:06.995213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:06.995219] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.005481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.015212] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.015247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.015260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.015266] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.015271] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.025629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.035220] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.035254] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.035267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.035273] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.035283] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.045438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.055471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.055507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.055521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.055527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.055532] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.065773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.075359] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.075398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.075415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.075421] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.075426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.085975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.095364] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.095397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.095410] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.095416] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.095421] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.105746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.115365] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.115400] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.115413] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.115419] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.115424] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.125965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.135472] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.135509] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.135522] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.135528] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.135533] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.145857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.155465] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.155499] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.155512] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.155518] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.155526] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.166039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.175540] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.175574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.175587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.175593] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.175599] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.185917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.195657] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.195692] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.195706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.195712] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.195717] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.206171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.215662] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.215701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.215715] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.215721] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.215727] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:12.974 [2024-04-23 21:34:07.226045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:12.974 qpair failed and we were unable to recover it. 00:33:12.974 [2024-04-23 21:34:07.235755] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:12.974 [2024-04-23 21:34:07.235790] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:12.974 [2024-04-23 21:34:07.235803] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:12.974 [2024-04-23 21:34:07.235809] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:12.974 [2024-04-23 21:34:07.235815] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.246318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.255856] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.255892] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.255906] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.255912] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.255918] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.266258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.275868] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.275906] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.275919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.275925] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.275930] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.286510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.295982] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.296022] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.296035] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.296040] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.296046] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.306450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.315975] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.316012] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.316026] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.316032] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.316037] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.326400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.336082] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.336115] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.336132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.336138] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.336143] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.346513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.356110] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.356144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.356157] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.356163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.356169] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.366538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.376153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.376191] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.376205] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.376212] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.376217] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.386627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.396203] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.396237] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.396251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.396257] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.396262] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.406634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.234 qpair failed and we were unable to recover it. 00:33:13.234 [2024-04-23 21:34:07.416216] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.234 [2024-04-23 21:34:07.416253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.234 [2024-04-23 21:34:07.416266] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.234 [2024-04-23 21:34:07.416272] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.234 [2024-04-23 21:34:07.416284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.234 [2024-04-23 21:34:07.426922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.235 qpair failed and we were unable to recover it. 00:33:13.235 [2024-04-23 21:34:07.436330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.235 [2024-04-23 21:34:07.436363] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.235 [2024-04-23 21:34:07.436376] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.235 [2024-04-23 21:34:07.436382] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.235 [2024-04-23 21:34:07.436387] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.235 [2024-04-23 21:34:07.446807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.235 qpair failed and we were unable to recover it. 00:33:13.235 [2024-04-23 21:34:07.456406] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.235 [2024-04-23 21:34:07.456445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.235 [2024-04-23 21:34:07.456458] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.235 [2024-04-23 21:34:07.456464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.235 [2024-04-23 21:34:07.456469] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.235 [2024-04-23 21:34:07.466821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.235 qpair failed and we were unable to recover it. 00:33:13.235 [2024-04-23 21:34:07.476517] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.235 [2024-04-23 21:34:07.476551] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.235 [2024-04-23 21:34:07.476564] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.235 [2024-04-23 21:34:07.476571] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.235 [2024-04-23 21:34:07.476576] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.235 [2024-04-23 21:34:07.486976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.235 qpair failed and we were unable to recover it. 00:33:13.235 [2024-04-23 21:34:07.496498] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.235 [2024-04-23 21:34:07.496534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.235 [2024-04-23 21:34:07.496547] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.235 [2024-04-23 21:34:07.496553] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.235 [2024-04-23 21:34:07.496558] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.493 [2024-04-23 21:34:07.506975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.493 qpair failed and we were unable to recover it. 00:33:13.493 [2024-04-23 21:34:07.516553] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.494 [2024-04-23 21:34:07.516589] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.494 [2024-04-23 21:34:07.516605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.494 [2024-04-23 21:34:07.516611] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.494 [2024-04-23 21:34:07.516616] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.494 [2024-04-23 21:34:07.527151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.494 qpair failed and we were unable to recover it. 00:33:13.494 [2024-04-23 21:34:07.536757] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.494 [2024-04-23 21:34:07.536797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.494 [2024-04-23 21:34:07.536811] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.494 [2024-04-23 21:34:07.536817] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.494 [2024-04-23 21:34:07.536822] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.494 [2024-04-23 21:34:07.547079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.494 qpair failed and we were unable to recover it. 00:33:13.494 [2024-04-23 21:34:07.556680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.494 [2024-04-23 21:34:07.556719] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.494 [2024-04-23 21:34:07.556732] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.494 [2024-04-23 21:34:07.556738] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.494 [2024-04-23 21:34:07.556743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.494 [2024-04-23 21:34:07.567317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.494 qpair failed and we were unable to recover it. 00:33:13.494 [2024-04-23 21:34:07.576579] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.494 [2024-04-23 21:34:07.576615] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.494 [2024-04-23 21:34:07.576628] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.494 [2024-04-23 21:34:07.576634] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.494 [2024-04-23 21:34:07.576639] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.494 [2024-04-23 21:34:07.587191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.494 qpair failed and we were unable to recover it. 00:33:13.494 [2024-04-23 21:34:07.596833] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:13.494 [2024-04-23 21:34:07.596867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:13.494 [2024-04-23 21:34:07.596880] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:13.494 [2024-04-23 21:34:07.596886] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:13.494 [2024-04-23 21:34:07.596894] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:13.494 [2024-04-23 21:34:07.607225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:13.494 qpair failed and we were unable to recover it. 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Write completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 Read completed with error (sct=0, sc=8) 00:33:14.431 starting I/O failed 00:33:14.431 [2024-04-23 21:34:08.612434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:14.431 [2024-04-23 21:34:08.619392] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.431 [2024-04-23 21:34:08.619436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.431 [2024-04-23 21:34:08.619451] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.431 [2024-04-23 21:34:08.619457] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.431 [2024-04-23 21:34:08.619463] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:14.431 [2024-04-23 21:34:08.630164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:14.431 qpair failed and we were unable to recover it. 00:33:14.431 [2024-04-23 21:34:08.639858] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.431 [2024-04-23 21:34:08.639897] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.431 [2024-04-23 21:34:08.639910] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.431 [2024-04-23 21:34:08.639917] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.431 [2024-04-23 21:34:08.639922] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:14.431 [2024-04-23 21:34:08.650306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:14.431 qpair failed and we were unable to recover it. 00:33:14.431 [2024-04-23 21:34:08.659952] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.431 [2024-04-23 21:34:08.659985] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.431 [2024-04-23 21:34:08.660004] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.431 [2024-04-23 21:34:08.660011] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.431 [2024-04-23 21:34:08.660017] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:14.431 [2024-04-23 21:34:08.670172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:14.431 qpair failed and we were unable to recover it. 00:33:14.431 [2024-04-23 21:34:08.680003] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.431 [2024-04-23 21:34:08.680038] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.431 [2024-04-23 21:34:08.680051] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.431 [2024-04-23 21:34:08.680057] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.431 [2024-04-23 21:34:08.680063] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:14.431 [2024-04-23 21:34:08.690505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:14.431 qpair failed and we were unable to recover it. 00:33:14.431 [2024-04-23 21:34:08.690576] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:33:14.431 A controller has encountered a failure and is being reset. 00:33:14.431 [2024-04-23 21:34:08.700051] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.431 [2024-04-23 21:34:08.700090] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.431 [2024-04-23 21:34:08.700112] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.431 [2024-04-23 21:34:08.700121] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.431 [2024-04-23 21:34:08.700129] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:14.690 [2024-04-23 21:34:08.710517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:14.690 qpair failed and we were unable to recover it. 00:33:14.690 [2024-04-23 21:34:08.720057] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:14.690 [2024-04-23 21:34:08.720097] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:14.690 [2024-04-23 21:34:08.720111] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:14.690 [2024-04-23 21:34:08.720117] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:14.690 [2024-04-23 21:34:08.720122] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:14.690 [2024-04-23 21:34:08.730633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:14.690 qpair failed and we were unable to recover it. 00:33:14.690 [2024-04-23 21:34:08.730757] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:14.690 [2024-04-23 21:34:08.763183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:14.690 Controller properly reset. 00:33:14.690 Initializing NVMe Controllers 00:33:14.690 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:14.690 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:14.690 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:33:14.690 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:33:14.690 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:33:14.690 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:33:14.690 Initialization complete. Launching workers. 00:33:14.690 Starting thread on core 1 00:33:14.690 Starting thread on core 2 00:33:14.690 Starting thread on core 3 00:33:14.690 Starting thread on core 0 00:33:14.690 21:34:08 -- host/target_disconnect.sh@59 -- # sync 00:33:14.690 00:33:14.690 real 0m12.496s 00:33:14.690 user 0m27.850s 00:33:14.690 sys 0m2.159s 00:33:14.690 21:34:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:14.690 21:34:08 -- common/autotest_common.sh@10 -- # set +x 00:33:14.690 ************************************ 00:33:14.690 END TEST nvmf_target_disconnect_tc2 00:33:14.690 ************************************ 00:33:14.690 21:34:08 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:33:14.691 21:34:08 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:33:14.691 21:34:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:14.691 21:34:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:14.691 21:34:08 -- common/autotest_common.sh@10 -- # set +x 00:33:14.950 ************************************ 00:33:14.950 START TEST nvmf_target_disconnect_tc3 00:33:14.950 ************************************ 00:33:14.950 21:34:08 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:33:14.950 21:34:08 -- host/target_disconnect.sh@65 -- # reconnectpid=1586930 00:33:14.950 21:34:08 -- host/target_disconnect.sh@67 -- # sleep 2 00:33:14.950 21:34:08 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:33:14.950 EAL: No free 2048 kB hugepages reported on node 1 00:33:16.853 21:34:10 -- host/target_disconnect.sh@68 -- # kill -9 1585143 00:33:16.853 21:34:10 -- host/target_disconnect.sh@70 -- # sleep 2 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Read completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.227 Write completed with error (sct=0, sc=8) 00:33:18.227 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Write completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 Read completed with error (sct=0, sc=8) 00:33:18.228 starting I/O failed 00:33:18.228 [2024-04-23 21:34:12.126995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:18.796 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 1585143 Killed "${NVMF_APP[@]}" "$@" 00:33:18.796 21:34:12 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:33:18.796 21:34:12 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:18.796 21:34:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:18.796 21:34:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:18.796 21:34:12 -- common/autotest_common.sh@10 -- # set +x 00:33:18.796 21:34:12 -- nvmf/common.sh@470 -- # nvmfpid=1587786 00:33:18.796 21:34:12 -- nvmf/common.sh@471 -- # waitforlisten 1587786 00:33:18.796 21:34:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:18.796 21:34:12 -- common/autotest_common.sh@817 -- # '[' -z 1587786 ']' 00:33:18.796 21:34:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:18.796 21:34:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:18.796 21:34:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:18.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:18.796 21:34:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:18.796 21:34:12 -- common/autotest_common.sh@10 -- # set +x 00:33:18.796 [2024-04-23 21:34:13.021802] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:33:18.796 [2024-04-23 21:34:13.021846] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:18.796 EAL: No free 2048 kB hugepages reported on node 1 00:33:19.054 [2024-04-23 21:34:13.089943] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Read completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 Write completed with error (sct=0, sc=8) 00:33:19.054 starting I/O failed 00:33:19.054 [2024-04-23 21:34:13.132126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:19.054 [2024-04-23 21:34:13.155369] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:19.054 [2024-04-23 21:34:13.155398] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:19.054 [2024-04-23 21:34:13.155405] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:19.054 [2024-04-23 21:34:13.155410] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:19.054 [2024-04-23 21:34:13.155414] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:19.054 [2024-04-23 21:34:13.155561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:19.054 [2024-04-23 21:34:13.155667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:19.054 [2024-04-23 21:34:13.155772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:19.054 [2024-04-23 21:34:13.155773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:19.622 21:34:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:19.622 21:34:13 -- common/autotest_common.sh@850 -- # return 0 00:33:19.622 21:34:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:19.622 21:34:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:19.622 21:34:13 -- common/autotest_common.sh@10 -- # set +x 00:33:19.622 21:34:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:19.622 21:34:13 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:19.622 21:34:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.622 21:34:13 -- common/autotest_common.sh@10 -- # set +x 00:33:19.622 Malloc0 00:33:19.622 21:34:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.622 21:34:13 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:19.622 21:34:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.622 21:34:13 -- common/autotest_common.sh@10 -- # set +x 00:33:19.622 [2024-04-23 21:34:13.884206] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13827d0/0x138e340) succeed. 00:33:19.622 [2024-04-23 21:34:13.893567] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1383e10/0x142e440) succeed. 00:33:19.881 21:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.881 21:34:14 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:19.881 21:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.881 21:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:19.881 21:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.881 21:34:14 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:19.881 21:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.881 21:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:19.881 21:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.881 21:34:14 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:33:19.881 21:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.881 21:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:19.881 [2024-04-23 21:34:14.022440] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:33:19.881 21:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.881 21:34:14 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:33:19.881 21:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.881 21:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:19.881 21:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.881 21:34:14 -- host/target_disconnect.sh@73 -- # wait 1586930 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Read completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 Write completed with error (sct=0, sc=8) 00:33:19.881 starting I/O failed 00:33:19.881 [2024-04-23 21:34:14.137047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:19.881 [2024-04-23 21:34:14.138568] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:19.881 [2024-04-23 21:34:14.138585] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:19.881 [2024-04-23 21:34:14.138591] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:21.256 [2024-04-23 21:34:15.142375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:21.256 qpair failed and we were unable to recover it. 00:33:21.256 [2024-04-23 21:34:15.143822] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:21.256 [2024-04-23 21:34:15.143836] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:21.256 [2024-04-23 21:34:15.143842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:22.192 [2024-04-23 21:34:16.147595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:22.192 qpair failed and we were unable to recover it. 00:33:22.192 [2024-04-23 21:34:16.149009] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:22.192 [2024-04-23 21:34:16.149023] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:22.192 [2024-04-23 21:34:16.149028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:23.129 [2024-04-23 21:34:17.152798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:23.129 qpair failed and we were unable to recover it. 00:33:23.129 [2024-04-23 21:34:17.154257] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:23.129 [2024-04-23 21:34:17.154273] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:23.129 [2024-04-23 21:34:17.154282] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:24.067 [2024-04-23 21:34:18.157899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:24.067 qpair failed and we were unable to recover it. 00:33:24.067 [2024-04-23 21:34:18.159349] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:24.067 [2024-04-23 21:34:18.159364] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:24.067 [2024-04-23 21:34:18.159369] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:25.003 [2024-04-23 21:34:19.163034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:25.003 qpair failed and we were unable to recover it. 00:33:25.003 [2024-04-23 21:34:19.164365] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:25.003 [2024-04-23 21:34:19.164378] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:25.003 [2024-04-23 21:34:19.164383] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:25.979 [2024-04-23 21:34:20.168203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:25.979 qpair failed and we were unable to recover it. 00:33:25.979 [2024-04-23 21:34:20.169703] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:25.979 [2024-04-23 21:34:20.169717] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:25.979 [2024-04-23 21:34:20.169723] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:26.930 [2024-04-23 21:34:21.173431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:26.930 qpair failed and we were unable to recover it. 00:33:26.930 [2024-04-23 21:34:21.174901] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:26.930 [2024-04-23 21:34:21.174921] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:26.930 [2024-04-23 21:34:21.174928] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:28.304 [2024-04-23 21:34:22.178703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:28.304 qpair failed and we were unable to recover it. 00:33:28.304 [2024-04-23 21:34:22.180052] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:28.304 [2024-04-23 21:34:22.180065] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:28.304 [2024-04-23 21:34:22.180070] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:29.237 [2024-04-23 21:34:23.183816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:29.237 qpair failed and we were unable to recover it. 00:33:29.237 [2024-04-23 21:34:23.183916] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:33:29.237 A controller has encountered a failure and is being reset. 00:33:29.237 Resorting to new failover address 192.168.100.9 00:33:29.237 [2024-04-23 21:34:23.185392] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:29.237 [2024-04-23 21:34:23.185418] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:29.237 [2024-04-23 21:34:23.185426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:30.171 [2024-04-23 21:34:24.189300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:30.171 qpair failed and we were unable to recover it. 00:33:30.171 [2024-04-23 21:34:24.190634] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:30.171 [2024-04-23 21:34:24.190648] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:30.171 [2024-04-23 21:34:24.190653] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:31.109 [2024-04-23 21:34:25.194340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:31.109 qpair failed and we were unable to recover it. 00:33:31.109 [2024-04-23 21:34:25.194430] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:31.109 [2024-04-23 21:34:25.194526] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:31.109 [2024-04-23 21:34:25.196335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:31.109 Controller properly reset. 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Write completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 Read completed with error (sct=0, sc=8) 00:33:32.046 starting I/O failed 00:33:32.046 [2024-04-23 21:34:26.241851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:32.046 Initializing NVMe Controllers 00:33:32.046 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:32.046 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:32.046 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:33:32.046 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:33:32.046 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:33:32.046 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:33:32.046 Initialization complete. Launching workers. 00:33:32.046 Starting thread on core 1 00:33:32.046 Starting thread on core 2 00:33:32.046 Starting thread on core 3 00:33:32.046 Starting thread on core 0 00:33:32.046 21:34:26 -- host/target_disconnect.sh@74 -- # sync 00:33:32.046 00:33:32.046 real 0m17.319s 00:33:32.046 user 1m1.492s 00:33:32.046 sys 0m3.975s 00:33:32.046 21:34:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:32.046 21:34:26 -- common/autotest_common.sh@10 -- # set +x 00:33:32.046 ************************************ 00:33:32.046 END TEST nvmf_target_disconnect_tc3 00:33:32.046 ************************************ 00:33:32.305 21:34:26 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:33:32.305 21:34:26 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:33:32.305 21:34:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:33:32.305 21:34:26 -- nvmf/common.sh@117 -- # sync 00:33:32.305 21:34:26 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:33:32.305 21:34:26 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:33:32.305 21:34:26 -- nvmf/common.sh@120 -- # set +e 00:33:32.305 21:34:26 -- nvmf/common.sh@121 -- # for i in {1..20} 00:33:32.305 21:34:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:33:32.305 rmmod nvme_rdma 00:33:32.305 rmmod nvme_fabrics 00:33:32.305 21:34:26 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:33:32.305 21:34:26 -- nvmf/common.sh@124 -- # set -e 00:33:32.305 21:34:26 -- nvmf/common.sh@125 -- # return 0 00:33:32.305 21:34:26 -- nvmf/common.sh@478 -- # '[' -n 1587786 ']' 00:33:32.305 21:34:26 -- nvmf/common.sh@479 -- # killprocess 1587786 00:33:32.305 21:34:26 -- common/autotest_common.sh@936 -- # '[' -z 1587786 ']' 00:33:32.305 21:34:26 -- common/autotest_common.sh@940 -- # kill -0 1587786 00:33:32.305 21:34:26 -- common/autotest_common.sh@941 -- # uname 00:33:32.305 21:34:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:32.305 21:34:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1587786 00:33:32.305 21:34:26 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:33:32.305 21:34:26 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:33:32.305 21:34:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1587786' 00:33:32.305 killing process with pid 1587786 00:33:32.305 21:34:26 -- common/autotest_common.sh@955 -- # kill 1587786 00:33:32.305 21:34:26 -- common/autotest_common.sh@960 -- # wait 1587786 00:33:32.305 [2024-04-23 21:34:26.491143] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:33:32.563 21:34:26 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:33:32.563 21:34:26 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:33:32.563 00:33:32.563 real 0m37.265s 00:33:32.563 user 2m25.613s 00:33:32.563 sys 0m10.897s 00:33:32.563 21:34:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:32.563 21:34:26 -- common/autotest_common.sh@10 -- # set +x 00:33:32.563 ************************************ 00:33:32.563 END TEST nvmf_target_disconnect 00:33:32.563 ************************************ 00:33:32.563 21:34:26 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:33:32.563 21:34:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:32.563 21:34:26 -- common/autotest_common.sh@10 -- # set +x 00:33:32.563 21:34:26 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:33:32.563 00:33:32.563 real 25m41.732s 00:33:32.563 user 80m0.347s 00:33:32.563 sys 4m51.942s 00:33:32.563 21:34:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:32.563 21:34:26 -- common/autotest_common.sh@10 -- # set +x 00:33:32.563 ************************************ 00:33:32.563 END TEST nvmf_rdma 00:33:32.563 ************************************ 00:33:32.563 21:34:26 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:33:32.563 21:34:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:33:32.563 21:34:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:32.563 21:34:26 -- common/autotest_common.sh@10 -- # set +x 00:33:32.823 ************************************ 00:33:32.823 START TEST spdkcli_nvmf_rdma 00:33:32.823 ************************************ 00:33:32.823 21:34:26 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:33:32.823 * Looking for test storage... 00:33:32.823 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:33:32.823 21:34:27 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:33:32.823 21:34:27 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:33:32.823 21:34:27 -- nvmf/common.sh@7 -- # uname -s 00:33:32.823 21:34:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:32.823 21:34:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:32.823 21:34:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:32.823 21:34:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:32.823 21:34:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:32.823 21:34:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:32.823 21:34:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:32.823 21:34:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:32.823 21:34:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:32.823 21:34:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:32.823 21:34:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:33:32.823 21:34:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:33:32.823 21:34:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:32.823 21:34:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:32.823 21:34:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:32.823 21:34:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:33:32.823 21:34:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:33:32.823 21:34:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:32.823 21:34:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:32.823 21:34:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:32.823 21:34:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.823 21:34:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.823 21:34:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.823 21:34:27 -- paths/export.sh@5 -- # export PATH 00:33:32.823 21:34:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.823 21:34:27 -- nvmf/common.sh@47 -- # : 0 00:33:32.823 21:34:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:33:32.823 21:34:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:33:32.823 21:34:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:33:32.823 21:34:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:32.823 21:34:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:32.823 21:34:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:33:32.823 21:34:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:33:32.823 21:34:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:33:32.823 21:34:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:32.823 21:34:27 -- common/autotest_common.sh@10 -- # set +x 00:33:32.823 21:34:27 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:33:32.823 21:34:27 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1590529 00:33:32.823 21:34:27 -- spdkcli/common.sh@34 -- # waitforlisten 1590529 00:33:32.823 21:34:27 -- common/autotest_common.sh@817 -- # '[' -z 1590529 ']' 00:33:32.823 21:34:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:32.823 21:34:27 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:33:32.823 21:34:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:32.823 21:34:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:32.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:32.823 21:34:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:32.823 21:34:27 -- common/autotest_common.sh@10 -- # set +x 00:33:33.083 [2024-04-23 21:34:27.099599] Starting SPDK v24.05-pre git sha1 3f2c8979187 / DPDK 23.11.0 initialization... 00:33:33.083 [2024-04-23 21:34:27.099638] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1590529 ] 00:33:33.083 EAL: No free 2048 kB hugepages reported on node 1 00:33:33.083 [2024-04-23 21:34:27.149705] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:33:33.083 [2024-04-23 21:34:27.214636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:33.083 [2024-04-23 21:34:27.214638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:33.651 21:34:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:33.651 21:34:27 -- common/autotest_common.sh@850 -- # return 0 00:33:33.651 21:34:27 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:33:33.651 21:34:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:33.651 21:34:27 -- common/autotest_common.sh@10 -- # set +x 00:33:33.651 21:34:27 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:33:33.651 21:34:27 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:33:33.651 21:34:27 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:33:33.651 21:34:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:33:33.651 21:34:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:33.651 21:34:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:33:33.651 21:34:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:33:33.651 21:34:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:33:33.651 21:34:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:33.651 21:34:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:33.651 21:34:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:33.651 21:34:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:33:33.651 21:34:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:33:33.651 21:34:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:33:33.651 21:34:27 -- common/autotest_common.sh@10 -- # set +x 00:33:40.221 21:34:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:40.221 21:34:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:40.221 21:34:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:40.221 21:34:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:40.221 21:34:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:40.221 21:34:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:40.221 21:34:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:40.221 21:34:33 -- nvmf/common.sh@295 -- # net_devs=() 00:33:40.221 21:34:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:40.221 21:34:33 -- nvmf/common.sh@296 -- # e810=() 00:33:40.221 21:34:33 -- nvmf/common.sh@296 -- # local -ga e810 00:33:40.221 21:34:33 -- nvmf/common.sh@297 -- # x722=() 00:33:40.221 21:34:33 -- nvmf/common.sh@297 -- # local -ga x722 00:33:40.221 21:34:33 -- nvmf/common.sh@298 -- # mlx=() 00:33:40.221 21:34:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:40.221 21:34:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:40.221 21:34:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:33:40.221 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:33:40.221 21:34:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:40.221 21:34:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:33:40.221 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:33:40.221 21:34:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:40.221 21:34:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:40.221 21:34:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:40.221 21:34:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:33:40.221 Found net devices under 0000:18:00.0: mlx_0_0 00:33:40.221 21:34:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:40.221 21:34:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:40.221 21:34:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:33:40.221 Found net devices under 0000:18:00.1: mlx_0_1 00:33:40.221 21:34:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:40.221 21:34:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:40.221 21:34:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:40.221 21:34:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:40.221 21:34:33 -- nvmf/common.sh@58 -- # uname 00:33:40.221 21:34:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:40.221 21:34:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:40.221 21:34:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:40.221 21:34:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:40.221 21:34:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:40.221 21:34:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:40.221 21:34:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:40.221 21:34:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:40.221 21:34:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:40.221 21:34:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:40.221 21:34:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:40.221 21:34:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:40.221 21:34:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:40.221 21:34:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:40.221 21:34:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:40.221 21:34:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:40.221 21:34:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:40.221 21:34:33 -- nvmf/common.sh@105 -- # continue 2 00:33:40.221 21:34:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.221 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:40.221 21:34:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:40.221 21:34:33 -- nvmf/common.sh@105 -- # continue 2 00:33:40.221 21:34:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:40.221 21:34:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:33:40.221 21:34:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:40.222 21:34:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:40.222 21:34:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:33:40.222 60: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:40.222 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:33:40.222 altname enp24s0f0np0 00:33:40.222 altname ens785f0np0 00:33:40.222 inet 192.168.100.8/24 scope global mlx_0_0 00:33:40.222 valid_lft forever preferred_lft forever 00:33:40.222 21:34:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:40.222 21:34:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:40.222 21:34:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:40.222 21:34:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:33:40.222 61: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:40.222 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:33:40.222 altname enp24s0f1np1 00:33:40.222 altname ens785f1np1 00:33:40.222 inet 192.168.100.9/24 scope global mlx_0_1 00:33:40.222 valid_lft forever preferred_lft forever 00:33:40.222 21:34:33 -- nvmf/common.sh@411 -- # return 0 00:33:40.222 21:34:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:40.222 21:34:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:40.222 21:34:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:40.222 21:34:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:40.222 21:34:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:40.222 21:34:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:40.222 21:34:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:40.222 21:34:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:40.222 21:34:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:40.222 21:34:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:40.222 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.222 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@105 -- # continue 2 00:33:40.222 21:34:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:40.222 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.222 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:40.222 21:34:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:40.222 21:34:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@105 -- # continue 2 00:33:40.222 21:34:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:40.222 21:34:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:40.222 21:34:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:40.222 21:34:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:40.222 21:34:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:40.222 21:34:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:40.222 192.168.100.9' 00:33:40.222 21:34:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:40.222 192.168.100.9' 00:33:40.222 21:34:33 -- nvmf/common.sh@446 -- # head -n 1 00:33:40.222 21:34:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:40.222 21:34:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:40.222 192.168.100.9' 00:33:40.222 21:34:33 -- nvmf/common.sh@447 -- # tail -n +2 00:33:40.222 21:34:33 -- nvmf/common.sh@447 -- # head -n 1 00:33:40.222 21:34:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:40.222 21:34:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:40.222 21:34:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:40.222 21:34:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:40.222 21:34:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:40.222 21:34:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:40.222 21:34:33 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:33:40.222 21:34:33 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:33:40.222 21:34:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:40.222 21:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:40.222 21:34:33 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:33:40.222 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:33:40.222 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:33:40.222 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:33:40.222 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:33:40.222 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:33:40.222 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:33:40.222 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:33:40.222 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:33:40.222 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:33:40.222 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:33:40.222 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:33:40.222 ' 00:33:40.222 [2024-04-23 21:34:33.782560] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:33:41.602 [2024-04-23 21:34:35.812339] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x224a1d0/0x239a1c0) succeed. 00:33:41.602 [2024-04-23 21:34:35.822931] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x224b8b0/0x2259fc0) succeed. 00:33:42.975 [2024-04-23 21:34:37.045557] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:33:45.503 [2024-04-23 21:34:39.204108] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:33:46.877 [2024-04-23 21:34:41.058138] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:33:48.256 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:33:48.257 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:33:48.257 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:33:48.257 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:33:48.257 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:33:48.257 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:33:48.257 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:33:48.516 21:34:42 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:33:48.516 21:34:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:48.516 21:34:42 -- common/autotest_common.sh@10 -- # set +x 00:33:48.516 21:34:42 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:33:48.516 21:34:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:48.516 21:34:42 -- common/autotest_common.sh@10 -- # set +x 00:33:48.516 21:34:42 -- spdkcli/nvmf.sh@69 -- # check_match 00:33:48.516 21:34:42 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:33:48.773 21:34:42 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:33:48.773 21:34:43 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:33:48.773 21:34:43 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:33:48.773 21:34:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:48.773 21:34:43 -- common/autotest_common.sh@10 -- # set +x 00:33:48.773 21:34:43 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:33:48.773 21:34:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:48.773 21:34:43 -- common/autotest_common.sh@10 -- # set +x 00:33:48.773 21:34:43 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:33:48.773 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:33:48.773 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:33:48.773 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:33:48.773 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:33:48.773 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:33:48.773 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:33:48.773 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:33:48.773 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:33:48.773 ' 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:33:54.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:33:54.044 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:33:54.044 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:33:54.044 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:33:54.044 21:34:47 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:33:54.044 21:34:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:54.044 21:34:47 -- common/autotest_common.sh@10 -- # set +x 00:33:54.044 21:34:47 -- spdkcli/nvmf.sh@90 -- # killprocess 1590529 00:33:54.044 21:34:47 -- common/autotest_common.sh@936 -- # '[' -z 1590529 ']' 00:33:54.044 21:34:47 -- common/autotest_common.sh@940 -- # kill -0 1590529 00:33:54.044 21:34:47 -- common/autotest_common.sh@941 -- # uname 00:33:54.044 21:34:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:54.044 21:34:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1590529 00:33:54.045 21:34:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:33:54.045 21:34:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:33:54.045 21:34:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1590529' 00:33:54.045 killing process with pid 1590529 00:33:54.045 21:34:48 -- common/autotest_common.sh@955 -- # kill 1590529 00:33:54.045 [2024-04-23 21:34:48.014422] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:33:54.045 21:34:48 -- common/autotest_common.sh@960 -- # wait 1590529 00:33:54.045 [2024-04-23 21:34:48.063197] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:33:54.045 21:34:48 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:33:54.045 21:34:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:33:54.045 21:34:48 -- nvmf/common.sh@117 -- # sync 00:33:54.045 21:34:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:33:54.045 21:34:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:33:54.045 21:34:48 -- nvmf/common.sh@120 -- # set +e 00:33:54.045 21:34:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:33:54.045 21:34:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:33:54.045 rmmod nvme_rdma 00:33:54.045 rmmod nvme_fabrics 00:33:54.045 21:34:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:33:54.045 21:34:48 -- nvmf/common.sh@124 -- # set -e 00:33:54.045 21:34:48 -- nvmf/common.sh@125 -- # return 0 00:33:54.045 21:34:48 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:33:54.045 21:34:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:33:54.045 21:34:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:33:54.045 00:33:54.045 real 0m21.376s 00:33:54.045 user 0m45.012s 00:33:54.045 sys 0m4.924s 00:33:54.303 21:34:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:54.304 21:34:48 -- common/autotest_common.sh@10 -- # set +x 00:33:54.304 ************************************ 00:33:54.304 END TEST spdkcli_nvmf_rdma 00:33:54.304 ************************************ 00:33:54.304 21:34:48 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:33:54.304 21:34:48 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:54.304 21:34:48 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:54.304 21:34:48 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:33:54.304 21:34:48 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:33:54.304 21:34:48 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:33:54.304 21:34:48 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:33:54.304 21:34:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:54.304 21:34:48 -- common/autotest_common.sh@10 -- # set +x 00:33:54.304 21:34:48 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:33:54.304 21:34:48 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:33:54.304 21:34:48 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:33:54.304 21:34:48 -- common/autotest_common.sh@10 -- # set +x 00:33:59.578 INFO: APP EXITING 00:33:59.578 INFO: killing all VMs 00:33:59.578 INFO: killing vhost app 00:33:59.578 INFO: EXIT DONE 00:34:02.164 Waiting for block devices as requested 00:34:02.164 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:02.164 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:02.423 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:02.423 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:02.423 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:02.682 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:02.682 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:02.682 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:02.682 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:02.941 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:02.941 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:34:07.131 Cleaning 00:34:07.131 Removing: /var/run/dpdk/spdk0/config 00:34:07.131 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:34:07.131 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:34:07.131 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:34:07.131 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:34:07.131 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:34:07.132 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:34:07.132 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:34:07.132 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:34:07.132 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:34:07.132 Removing: /var/run/dpdk/spdk0/hugepage_info 00:34:07.132 Removing: /var/run/dpdk/spdk1/config 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:34:07.132 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:34:07.132 Removing: /var/run/dpdk/spdk1/hugepage_info 00:34:07.132 Removing: /var/run/dpdk/spdk1/mp_socket 00:34:07.132 Removing: /var/run/dpdk/spdk2/config 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:34:07.132 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:34:07.132 Removing: /var/run/dpdk/spdk2/hugepage_info 00:34:07.132 Removing: /var/run/dpdk/spdk3/config 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:34:07.132 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:34:07.132 Removing: /var/run/dpdk/spdk3/hugepage_info 00:34:07.132 Removing: /var/run/dpdk/spdk4/config 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:34:07.132 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:34:07.132 Removing: /var/run/dpdk/spdk4/hugepage_info 00:34:07.132 Removing: /dev/shm/bdevperf_trace.pid1324153 00:34:07.132 Removing: /dev/shm/bdevperf_trace.pid1469513 00:34:07.132 Removing: /dev/shm/bdev_svc_trace.1 00:34:07.132 Removing: /dev/shm/nvmf_trace.0 00:34:07.132 Removing: /dev/shm/spdk_tgt_trace.pid1152636 00:34:07.132 Removing: /var/run/dpdk/spdk0 00:34:07.132 Removing: /var/run/dpdk/spdk1 00:34:07.132 Removing: /var/run/dpdk/spdk2 00:34:07.132 Removing: /var/run/dpdk/spdk3 00:34:07.132 Removing: /var/run/dpdk/spdk4 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1149231 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1150895 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1152636 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1153423 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1154465 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1154737 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1155856 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1156114 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1156503 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1161657 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1163555 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1163930 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1164256 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1164602 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1164940 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1165231 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1165519 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1165841 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1166950 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1170085 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1170394 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1170719 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1170953 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1171512 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1171526 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1172095 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1172337 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1172654 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1172675 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1172969 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1173230 00:34:07.132 Removing: /var/run/dpdk/spdk_pid1173619 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1173907 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1174233 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1174594 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1174827 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1174953 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1175284 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1175592 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1175887 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1176192 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1176485 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1176786 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1177114 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1177454 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1177768 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1178051 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1178343 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1178632 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1178923 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1179210 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1179501 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1179789 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1180086 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1180374 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1180666 00:34:07.391 Removing: /var/run/dpdk/spdk_pid1180953 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1181144 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1181627 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1185570 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1285354 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1289640 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1299181 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1304530 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1308211 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1309049 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1324153 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1324915 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1329225 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1335331 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1338253 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1348581 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1373517 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1377076 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1383420 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1418821 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1436956 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1467173 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1468223 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1469513 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1473823 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1480830 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1481948 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1482913 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1483923 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1484475 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1488966 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1488990 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1493719 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1494298 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1494972 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1495719 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1495936 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1499728 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1501941 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1504049 00:34:07.392 Removing: /var/run/dpdk/spdk_pid1506177 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1508633 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1510992 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1517640 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1518256 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1521937 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1523231 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1534493 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1539142 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1548246 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1548283 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1573204 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1573697 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1583224 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1583808 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1586930 00:34:07.651 Removing: /var/run/dpdk/spdk_pid1590529 00:34:07.651 Clean 00:34:07.651 21:35:01 -- common/autotest_common.sh@1437 -- # return 0 00:34:07.651 21:35:01 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:34:07.651 21:35:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:07.651 21:35:01 -- common/autotest_common.sh@10 -- # set +x 00:34:07.910 21:35:01 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:34:07.910 21:35:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:07.910 21:35:01 -- common/autotest_common.sh@10 -- # set +x 00:34:07.910 21:35:01 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:34:07.910 21:35:01 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:34:07.910 21:35:01 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:34:07.910 21:35:01 -- spdk/autotest.sh@389 -- # hash lcov 00:34:07.910 21:35:01 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:34:07.910 21:35:01 -- spdk/autotest.sh@391 -- # hostname 00:34:07.910 21:35:01 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-37 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:34:07.910 geninfo: WARNING: invalid characters removed from testname! 00:34:25.991 21:35:19 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:27.366 21:35:21 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:29.271 21:35:23 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:30.647 21:35:24 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:32.023 21:35:26 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:33.399 21:35:27 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:35.300 21:35:29 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:35.300 21:35:29 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:34:35.300 21:35:29 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:35.300 21:35:29 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:35.300 21:35:29 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:35.300 21:35:29 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:35.300 21:35:29 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:35.300 21:35:29 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:35.300 21:35:29 -- paths/export.sh@5 -- $ export PATH 00:34:35.300 21:35:29 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:35.300 21:35:29 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:34:35.300 21:35:29 -- common/autobuild_common.sh@435 -- $ date +%s 00:34:35.300 21:35:29 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713900929.XXXXXX 00:34:35.300 21:35:29 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713900929.UVBcsP 00:34:35.300 21:35:29 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:34:35.300 21:35:29 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:34:35.300 21:35:29 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:34:35.300 21:35:29 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:35.300 21:35:29 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:35.300 21:35:29 -- common/autobuild_common.sh@451 -- $ get_config_params 00:34:35.300 21:35:29 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:34:35.300 21:35:29 -- common/autotest_common.sh@10 -- $ set +x 00:34:35.300 21:35:29 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:34:35.300 21:35:29 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:34:35.300 21:35:29 -- pm/common@17 -- $ local monitor 00:34:35.300 21:35:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:35.300 21:35:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1610048 00:34:35.300 21:35:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:35.300 21:35:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1610049 00:34:35.300 21:35:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:35.300 21:35:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1610051 00:34:35.300 21:35:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:35.300 21:35:29 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1610053 00:34:35.300 21:35:29 -- pm/common@26 -- $ sleep 1 00:34:35.300 21:35:29 -- pm/common@21 -- $ date +%s 00:34:35.300 21:35:29 -- pm/common@21 -- $ date +%s 00:34:35.300 21:35:29 -- pm/common@21 -- $ date +%s 00:34:35.300 21:35:29 -- pm/common@21 -- $ date +%s 00:34:35.300 21:35:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713900929 00:34:35.300 21:35:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713900929 00:34:35.300 21:35:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713900929 00:34:35.300 21:35:29 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713900929 00:34:35.300 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713900929_collect-bmc-pm.bmc.pm.log 00:34:35.300 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713900929_collect-vmstat.pm.log 00:34:35.300 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713900929_collect-cpu-load.pm.log 00:34:35.300 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713900929_collect-cpu-temp.pm.log 00:34:36.236 21:35:30 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:34:36.236 21:35:30 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j112 00:34:36.236 21:35:30 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:36.236 21:35:30 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:36.236 21:35:30 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:36.236 21:35:30 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:36.236 21:35:30 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:36.236 21:35:30 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:36.236 21:35:30 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:36.236 21:35:30 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:34:36.236 21:35:30 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:36.236 21:35:30 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:34:36.236 21:35:30 -- pm/common@30 -- $ signal_monitor_resources TERM 00:34:36.236 21:35:30 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:34:36.236 21:35:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:36.236 21:35:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:34:36.236 21:35:30 -- pm/common@45 -- $ pid=1610062 00:34:36.236 21:35:30 -- pm/common@52 -- $ sudo kill -TERM 1610062 00:34:36.236 21:35:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:36.236 21:35:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:34:36.236 21:35:30 -- pm/common@45 -- $ pid=1610063 00:34:36.236 21:35:30 -- pm/common@52 -- $ sudo kill -TERM 1610063 00:34:36.236 21:35:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:36.236 21:35:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:34:36.236 21:35:30 -- pm/common@45 -- $ pid=1610065 00:34:36.236 21:35:30 -- pm/common@52 -- $ sudo kill -TERM 1610065 00:34:36.236 21:35:30 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:36.236 21:35:30 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:34:36.236 21:35:30 -- pm/common@45 -- $ pid=1610064 00:34:36.236 21:35:30 -- pm/common@52 -- $ sudo kill -TERM 1610064 00:34:36.236 + [[ -n 1037372 ]] 00:34:36.236 + sudo kill 1037372 00:34:36.246 [Pipeline] } 00:34:36.271 [Pipeline] // stage 00:34:36.295 [Pipeline] } 00:34:36.317 [Pipeline] // timeout 00:34:36.320 [Pipeline] } 00:34:36.329 [Pipeline] // catchError 00:34:36.332 [Pipeline] } 00:34:36.342 [Pipeline] // wrap 00:34:36.346 [Pipeline] } 00:34:36.354 [Pipeline] // catchError 00:34:36.360 [Pipeline] stage 00:34:36.361 [Pipeline] { (Epilogue) 00:34:36.368 [Pipeline] catchError 00:34:36.369 [Pipeline] { 00:34:36.377 [Pipeline] echo 00:34:36.378 Cleanup processes 00:34:36.381 [Pipeline] sh 00:34:36.659 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:36.659 1610176 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:34:36.659 1610567 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:36.671 [Pipeline] sh 00:34:36.954 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:36.954 ++ grep -v 'sudo pgrep' 00:34:36.954 ++ awk '{print $1}' 00:34:36.954 + sudo kill -9 1610176 00:34:36.966 [Pipeline] sh 00:34:37.250 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:45.416 [Pipeline] sh 00:34:45.698 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:45.698 Artifacts sizes are good 00:34:45.711 [Pipeline] archiveArtifacts 00:34:45.717 Archiving artifacts 00:34:45.923 [Pipeline] sh 00:34:46.228 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:34:46.241 [Pipeline] cleanWs 00:34:46.250 [WS-CLEANUP] Deleting project workspace... 00:34:46.250 [WS-CLEANUP] Deferred wipeout is used... 00:34:46.256 [WS-CLEANUP] done 00:34:46.258 [Pipeline] } 00:34:46.277 [Pipeline] // catchError 00:34:46.285 [Pipeline] sh 00:34:46.563 + logger -p user.info -t JENKINS-CI 00:34:46.571 [Pipeline] } 00:34:46.585 [Pipeline] // stage 00:34:46.590 [Pipeline] } 00:34:46.607 [Pipeline] // node 00:34:46.614 [Pipeline] End of Pipeline 00:34:46.652 Finished: SUCCESS